Nowadays, it’s rather common to encounter Apache Spark being utilized in a lot of companies that need to process huge amounts of data, and things aren’t any different here at SoundCloud — as one can imagine, we have lots of data to process all the time.
Backstage Blog RSS
August 14th, 2018 Engineering Creating Readable Spark Jobs By Luciano Molinari
July 26th, 2018 Management Engineering Getting a Team Back on Track By Arbo von Monkiewitsch
Sometimes, an important team that’s part of an otherwise healthy company culture starts tanking and the people on the team get frustrated and even quit.
In this article, I want to share what I learned when I started to manage a team — referred to as the R Team from here on out — that had huge problems when I took over as Engineering Manager, as well as explain how I got it back on track.
July 10th, 2018 Architecture Data Keeping Counts In Sync By Lorand Kasler
Track play counts are essential for providing a good creator experience on the SoundCloud platform. They not only help creators keep track of their most popular songs, but they also give creators a better understanding of their fanbase and global impact. This post is a continuation of an earlier post that discussed what we do at SoundCloud to ensure creators get their play stats (along with their other stats), both reliably and in real time.
June 22nd, 2018 Retrospective Leadership Tech Lead Engineering Defining a Role with a Retrospective Activity By Aleksandra Gavrilovska
Agile retrospectives are a widely used practice within engineering teams. They provide teams with a way to reflect on how they work and become better at what they do. One of the main benefits of retrospectives is that they empower teams to define and make changes by analyzing what happened in an iteration and by determining what can be improved moving forward. Here at SoundCloud, we hold retrospectives at the end of every iteration (every two weeks), and we often do them at the end of projects as well.
June 5th, 2018 Project Management Project Necromancy By Christine Patton
Or, how to raise a project from the dead with tools you probably have lying around at home.