Revolutionising the future of Television

Key Challenges

Our client dealing with a growing, high volume of varied, complex data required advanced support and maintenance to avoid loss of data, ensure high uptime and enable data accessibility.

Key Details

Leading consumer electronics brand

Dealing with huge volumes of data

Our client are a US-based, leading consumer electronics brand selling various electronic products such as LCD TVs, soundbars and operating systems for their smart TVs. They have been building innovative technology products for over two decades and are now an IPO listed company with an annual turnover of more than $2.1 billion. With a large consumer audience, our client collects huge volumes of TV data from their audience across the US.

Ensuring data availability, consistency and accuracy

Delivering data quickly and efficiently

Data availability for our client was crucial. They were dealing with vast volumes of varied, complex TV and commercial data. They collected the data from all users that have opted in across the US, and this large amount of data is coming in continuously. It was vital that the data was available for our client’s data science teams, accurate and full without any data drops or gaps.

Read our success story on building a 10 TB data lake

Optimising 4 petabytes of client data

Continuous data streams managed efficiently

Ardent’s exceptional engineers work around the clock to provide data engineering support to help effectively manage client data. Our data engineering team manage three Redshift clusters on behalf of the client, the first cluster contains the data for the previous month, the second cluster contains the data from the previous year and the third cluster is used for data sharing.

These clusters contain a substantially large amount of data as you can see in the image below. To put this into perspective, an average laptop has storage of around 256GB, so 1PB would equate to the storage of around 3,900 laptops.

One of the biggest technical challenges that our data engineering teams succeeded on was processing the data and delivering it to the client in near-real-time. Our expert data engineers were able to provide near real-time availability of the data to our client’s data science team by processing data in 6 parallel streams in Redshift, considerably increasing the speed at which the data available to the client.

The data is processed, transformed, loaded, and sent to the client ensuring that its free of duplication and errors and is delivered in near-real-time.

Advanced error detection and alerting

Ensuring data consistency

As part of the solution, our data engineers have the highest error detection and alerting processes in place with PagerDuty to ensure that any issues that arise are dealt with quickly and efficiently. Our teams are consistently monitoring the data around the clock to make certain that any errors that arise are communicated with the relevant teams and resolved immediately. This is to make sure that there is no loss of data which can lead to data gaps.

Progression of technologies

Continuous optimisation

We have been managing our client’s data for over seven years and how we do this has developed over time with the evolution of technologies. With a long-term project, consistent optimisation is key. Therefore, we are currently, we are in the process of moving data processing from Amazon S3 to AWS Firehouse for quicker data ingest and reporting for the client.

Find out about our technology partners.

Actionable commercial insights

Boosting revenue and growth

The Ardent data engineering team have been effectively managing our client’s data for over seven years and continue to innovate and evolve to improve data speed, accuracy and performance. We ensure that the client has peace of mind knowing that their data is in safe hands with Ardent and is managed effectively, securely and in line with industry best practices. Our client are able to use the data collected to gain meaningful insights for commercial benefit, boosting revenue and growth.

Explore our operational monitoring and support services or if you are looking to unlock your data potential get in touch today.

---