Loading…
DevConf.US '18 has ended
DevConf.us 2018 is the 1st annual, free, Red Hat sponsored technology conference for community project and professional contributors to Free and Open Source technologies held at the Boston University in the historic city of Boston, USA.

When: Friday, August 17 to Sunday, August 19, 2018

Venue: Boston University, George Sherman Union Building
Back To Schedule
Friday, August 17 • 3:50pm - 4:25pm
Data Hub for CI of Red Hat products

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
Data Hub is Red Hat internal data lake platform. Data Hub is extensively used for log aggregation and build log/test result aggregation.

I will present our architecture and best practices operating a data lake platform called ‘Data Hub’. I will present the major use cases of how we aggregate, replicate and analyze the data from internal and upstream Continuous Integration systems, from traditional and containerized applications. I will show how we do correlation of test results generated by the CI systems, Fedora project message bus(FedMsg), internal Red Hat message bus and how we onboard new CI systems in Data Hub.

The architecture for Data Hub includes: ELK stack, Kafka and other tools.
You can expect to see slides and demo in the presentation.
Speakers
avatar for Anton Sherkhonov

Anton Sherkhonov

Red Hat
Anton Sherkhonov is a Data Engineer in Red Hat AI Center of Excellence who partners with various internal Red Hat and upstream teams to help them deal with the data challenges and onboard them into Red Hat Data Hub.

Friday August 17, 2018 3:50pm - 4:25pm EDT
Conference Auditorium Boston University, George Sherman Union Building
  ML / AI / Serverless, Presentation

Attendees (33)