Senior Data Engineer /Software Engineer / Only W2

Dvi Technologies - Dallas, TX

Full-time - Mid Level

Dallas, TX

Professional, Scientific, and Technical Services

About the position

The Senior Data Engineer/Specialty Software Engineer is responsible for IT development, analysis, information management, and quality assurance, utilizing specialized knowledge in niche technologies. This role involves modifying databases, coordinating database development, and working closely with project teams to ensure successful implementation of new capabilities, particularly within the Hadoop platform.

Responsibilities

• Modify existing databases and database management systems.
• Write and code logical and physical database descriptions and specify identifiers of database to management system or direct others in coding descriptions.
• Work as part of a project team to coordinate database development and determine project scope and limitations.
• Review project requests describing database user needs to estimate time and cost required to accomplish project.
• Test new capabilities for the Hadoop platform.
• Work with customers to resolve any issues they encounter during implementation.
• Create user documentation and training materials.
• Optimize code as connections and conditions change.
• Plan and execute user program migration.

Requirements

• Experience with Apache Impala (4-6 years).
• Experience with Apache Spark (4-6 years).
• Proficiency in Bash, Python, and C/C++ (4-6 years).
• Experience in creating end user training manuals (4-6 years).
• Experience in end user training (4-6 years).
• Experience with Hadoop Cloudera (4-6 years).
• Experience with Hadoop Distributed File System (HDFS) (4-6 years).
• Experience with Hive/Hadoop (4-6 years).
• Experience with PySpark (4-6 years).

Nice-to-haves

• Bachelor's degree (preferred).