Technical Debt is a Social Problem

Technical debt is a big problem for the R community. Even though R has excellent support for testing, documentation and packaging code it has the reputation that it is not suitable for production...

Technical Debt is a Social Problem

February 5, 2020

Technical debt is a big problem for the R community. Even though R has excellent support for testing, documentation and packaging code it has the reputation that it is not suitable for production applications because data scientists don’t pay enough attention to technical debt within their codebases. Most people think of technical debt as an engineering problem. We choose to make our current work cheaper at the expense of needing to do more work down the road. But when you look closely at the root causes of technical debt they are almost always about interpersonal relationships. Developers have trouble empathizing with other users of their code and so don’t spend the time to make that code easy for future developers to use and understand. In this talk I argue that we should think about technical debt as a social problem because it gives us insight into why it’s so hard to pay back. I then provide a practical roadmap of how to introduce best practices into your data science team.

 

View Slides.


About the speaker

Gordon Shotwell

Gordon is a lawyer by training, and has worked with survey companies, correctional facilities, and web properties to improve their data analysis processes to allow more people to make better decisions. He is currently a Senior Data Scientist at Socure where he develops data products to help protect people against financial fraud.