Loading…
DevConf.US '18 has ended
DevConf.us 2018 is the 1st annual, free, Red Hat sponsored technology conference for community project and professional contributors to Free and Open Source technologies held at the Boston University in the historic city of Boston, USA.

When: Friday, August 17 to Sunday, August 19, 2018

Venue: Boston University, George Sherman Union Building
Friday, August 17 • 2:50pm - 3:25pm
Building Streaming Recommendation Engines on Spark

Sign up or log in to save this to your schedule and see who's attending!

Feedback form is now closed.
Collaborative filtering is a well known method to implement recommendation engines. Although modern techniques, such as Alternating Least Squares (ALS), allow us to perform rating predictions with large amounts of observations, typically ALS is implemented as a distributed batch algorithm where retraining must be performed with the entirety of the data. However, when dealing with large amounts of data as a stream, batch retraining might be problematic. In this talk Rui will guide us in building a streaming ALS implementation using Apache Spark and based on Stochastic Gradient Descent, where training can be performed using observations as they arrive. The advantages of real-time streaming collaborative filtering will be discussed as well as the scenarios where batch ALS might be preferable.

Speakers
avatar for Rui Vieira

Rui Vieira

Red Hat
Rui is a Software Engineer at Red Hat working on Data Science, Apache Spark and Spark Streaming applications.


Friday August 17, 2018 2:50pm - 3:25pm
Conference Auditorium Boston University, George Sherman Union Building

Attendees (31)