CDW
posted about 2 months ago
The Senior Software Engineer II - Data will play a pivotal role in building and operationalizing the minimally inclusive data necessary for the enterprise data and analytics initiatives following best practices. The bulk of the data engineer's work would be in building, managing, and optimizing data pipelines and then moving these data pipelines effectively into production for key data and analytics consumers like business/data analysts, data scientists, or any persona that needs curated data for data and analytics use cases across the enterprise. This position requires a strong focus on developing scalable data solutions that can handle increasing data volume and complexity, ensuring that the data is accessible and usable for various stakeholders within the organization. In this role, the engineer will develop and maintain scalable data pipelines to support the growing demands of data processing. They will interface with other technology teams to extract, transform, and load data from a wide variety of data sources using big data technologies and SQL. Collaboration with business teams is essential to improve data models that feed business intelligence tools, thereby increasing data accessibility and fostering data-driven decision-making across the organization. The engineer will also work closely with data science teams to engineer data sets that can be used for advanced analytics algorithms, including statistical analysis, prediction, clustering, and machine learning. The Senior Software Engineer II - Data will be responsible for using innovative and modern tools, techniques, and architectures to automate common, repeatable, and tedious data preparation and integration tasks. This will help minimize manual and error-prone processes, ultimately improving productivity. Additionally, the engineer will train counterparts such as data scientists and data analysts in data pipelines and preparation techniques, making it easier for them to integrate and consume the data they need for their own use cases. Compliance and governance during the use of data will also be a key responsibility, along with a commitment to staying informed about new data management techniques and their application to solve business problems.