The Business Need

A global Info Publisher in the United States wanted to extract, validate, and enrich data from over 250 data sources. They are one of the leading providers of big data and marketing services. Our client required in-depth research along with high accuracy in verifying various company-related information such as employee information, services, products, affiliates, etc.,

Challenges

• The data structure varied significantly between competitor sites and company websites, requiring different extraction approaches.
• Ensuring data accuracy and removing duplicates from a vast dataset was complex and time-intensive.
• Aggregating and enriching 20+ data points from multiple sources while maintaining consistency was a major challenge.

Solution

There were around 20 data points to be collected from 5 competitor sites and 200 company websites. The aggregated job data had to be further cleaned to remove duplicates and enriched to have complete information. Xtract.io developed two algorithms to extract relevant job data. One for aggregator sites and one for company websites because they varied in structure.

Results

The comprehensive data aggregated enabled our clients to better their candidate experience by providing more options to filter their search. The candidates were able to filter their jobs based on the aggregated data points like wages, location, etc., and even listed similar jobs that matched their search. The candidates were also able to see the wages and how the trend would grow in the future for a particular job or skill based on the data collected. Thus overall customer experience was improved based on the fresh and comprehensive data provided by Xtract.io.