Connecting Google BigQuery with Lightcast Data Shares

Lightcast provides clients with the world’s most comprehensive data and insights on labor market trends, job postings, workforce profiles, compensation, career pathways, skills projections, and demographics. Quickly slicing, dicing, and analyzing large datasets is now easier than ever following the launch of Lightcast data shares. 

What are Lightcast Data Shares?

With Lightcast Data Shares, Lightcast data is now available directly on Google BigQuery (GBQ) and other widely-used data warehouses, file storage platforms, and marketplaces.  

Data sharing through Lightcast is flexible and secure. Thanks to Lightest Data Shares, delivering data through data sharing is simple and clients also have the option to slice, edit, or prepare data before integrating it into internal or external solutions. Information shared through Data Shares is always current because data is shared directly with each client’s existing warehouse or cloud storage as platform-native sharing, a data feed, or both. 

Accepting Data Shares from Lightcast requires few internal technical resources from clients, which results in lower costs and increased efficiencies. Data Shares simplify the process of using Lightcast data for ingestion into large language models (LLMs), AI solutions, and predictive analytics models. 

Lightcast Data Shares can also be customized based on each organization’s business needs and each Data Shares integration can be fully operational in less than 48 hours.

How Data Shares and Google BigQuery Work Together

Google BigQuery is one of many delivery destinations supported by Lightcast Data Shares. To facilitate data sharing, Lightcast leverages Google Analytics Hub data exchanges.

Each Google principal granted access to the Lightcast share is authorized access to the shared datasets in the data exchange. Data consumers can access and subscribe to the data exchange's listing, enabling them to perform data queries within their projects.

What if I Don’t Use Google BigQuery? 

Lightcast supports several Data Shares destinations beyond Google BigQuery, including Snowflake, Databricks, Google Cloud Storage, Microsoft Azure Blob Storage, SFTP, and Amazon S3.

Accessing Data Shares via Web Console

You can easily access the data using the web console link to the Analytics Hub listing. You will need to be logged in to the Google Cloud console with the account that has been configured to access the Lightcast share.

1. Open the URL sent to you by Lightcast

2. Subscribe to the listing and create a linked dataset

Subscribing to the listing gives you read-only access to the data in the listing by creating a linked dataset in your project.

3. Go to the linked dataset to begin querying the data

Learn more about how Lightcast Data Shares work or contact our team to discuss your business requirements and connect Google Big Query with Lightcast Data Shares.