Use this Data Engineer job description template to advertise the open roles for free using Longlist.io. You can use this template as a starting point, modify the requirements according the needs of your organization or the client you are hiring for.
We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals.
To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods.
If you are detail-oriented, with excellent organizational skills and experience in this field, we’d like to hear from you.
A Data Engineer is responsible for designing, building, and maintaining the infrastructure required for processing and analyzing large volumes of data. Some of the typical tasks performed by a Data Engineer on a day-to-day basis include:
Data Ingestion: Collecting and capturing data from various sources, such as databases, APIs, or log files, and transferring it into data storage systems or data lakes.
Data Transformation: Cleaning and preprocessing the raw data to ensure consistency, accuracy, and quality. This may involve tasks like data validation, data cleansing, data enrichment, and data normalization.
Data Storage: Setting up and managing data storage systems, such as databases or data warehouses, to store the processed data in an organized and well-structured manner for efficient retrieval.
Data Pipeline Development: Building and maintaining data pipelines that automate the flow of data from its source to its destination. This includes tasks like data extraction, transformation, and loading (ETL) using tools like Apache Airflow, Apache Spark, or custom scripts.
Data Modeling: Designing and implementing data models that define how data should be organized, structured, and stored to support efficient querying and analysis. This may involve using techniques like relational databases, NoSQL databases, or data partitioning.
Data Quality Assurance: Implementing processes and mechanisms to ensure the quality and integrity of the data, such as data validation checks, data profiling, and data auditing.
Performance Optimization: Identifying and resolving performance bottlenecks in data processing and storage systems to optimize data retrieval and analysis.
Collaboration: Collaborating with data scientists, analysts, and other stakeholders to understand their data requirements and to ensure that the data infrastructure meets their needs.
Monitoring and Troubleshooting: Monitoring data workflows, data systems, and data pipelines to ensure they are running smoothly. Troubleshooting and resolving any issues or errors that arise.
Documentation: Documenting data engineering processes, data flows, and data infrastructure to maintain a clear and up-to-date record of the systems and processes in place.
About Craft:
Craft is the leader in supplier intelligence, enabling enterprises to discover, evaluate and continuously monitor their suppliers at scale. Our unique, proprietary data platform tracks real-time signals on millions of companies globally, delivering best in class monitoring and insight into global supply chains. Our customers include Fortune 500 companies, government agencies, SMEs...
Our Public Sector Group (PSG) is growing, and we are looking for a talented, highly motivated Senior Data Engineer to join ICF's Digital Modernization Division. ICF is seeking a highly motivated Senior Data Engineer to support digital solutions for a variety of Federal clients, including the Department of Labor. The Senior Data Engineer will support our projects by collaborating and working wit...
Data Engineer Required Fast Growing Healthcare Marketing Consultancy - New York- Remote - SQL / Python / Azure / AWS / GCP / Snowflake $100,000- $120,000 Benefits
Data Engineer Role required for fast growing consultancy in New York . They translate data into everyday language that drives positive change and accelerates strategic growth for a range of "big-name" clients, through defining... imp...
It's fun to work at a company where people truly believe in what they are doing!
Job Description...
Summary
The Data Engineering team within Data Management is growing and we are looking for Data Engineers. This position will be a key position of the Data Management team as we redefine how data is made available for use at Epiq. The Data Engineer will be responsible for expanding and develop...