R is more than just a tool for data analysis– it can help streamline and automate processes, including managing and monitoring data pipelines. This presentation highlights how R Markdown, RStudio Connect, and R Shiny can be utilized to automate data processing, error logging, and process monitoring. By the end of the presentation, attendees will better understand: (1) how RStudio Connect paired with R Markdown can be used to automate data processing, (2) that packages such as blastula and loggit can be used within R Markdown documents scheduled on RStudio Connect to email users when an error is encountered during data processing and log those errors, and (3) that the resulting logs can be fed to a Shiny app to enhance process monitoring.
Kolbi Parrish is an Informatics Specialist working at the California Department of Public Health (CDPH) through the University of California, San Francisco. She has worked in public health for over 10 years, has a Master’s degree in Industrial and Organizational Psychology, and is interested in leveraging data and technology to further public health goals.
Andy is a clinical informatics specialist working at the California Department of Public Health Data Processing and Informatics section, where he works on building disease surveillance data pipelines for gathering, processing and reporting. Andy has a Master's in Health Informatics and has been an avid R user since 2017.
