Python Developer

Intellibee - Hanover, NJ

Full-time - Mid Level

Hanover, NJ

Professional, Scientific, and Technical Services

About the position

The Python Developer role in Whippany, NJ, is focused on building and optimizing PySpark applications for both batch and streaming data processing. The position requires extensive experience in Python and Big Data technologies, particularly within Hadoop ecosystems. The developer will be responsible for the entire software development lifecycle, collaborating with cross-functional teams to deliver high-quality software solutions that meet complex business needs, particularly in the financial sector.

Responsibilities

• Build PySpark based applications for batch and streaming requirements.
• Optimize performance of Spark applications in Hadoop using configurations around Spark Context, Spark-SQL, Data Frame, and Pair RDD's.
• Develop, test, and maintain high-quality software using Python.
• Participate in the entire software development lifecycle, from building to delivering solutions.
• Collaborate with cross-functional teams to identify and solve complex problems.
• Design and implement web applications using Python frameworks like Streamlit.
• Create visualizations, custom widgets, and components for user-friendly web interfaces.
• Integrate APIs and databases with Streamlit applications.
• Work with large datasets and incomplete information as required.
• Engage with users, business stakeholders, and technology teams to understand customer needs and develop solutions independently.
• Rewrite and decompose legacy controls, transitioning from RBS Java to Python frameworks.

Requirements

• 8+ years of experience in Python, PySpark, and Hadoop Big Data.
• Strong backend development experience in Python.
• In-depth knowledge of Hadoop and NoSQL databases.
• Experience with Python libraries such as Pandas, Polars, NumPy, Matplotlib, Plotly, Seaborn, and Altair.
• Conceptually strong in Python and analytics.
• Experience in designing and implementing web applications using Python frameworks like Streamlit.
• Ability to work with large datasets and incomplete information.
• Experience in a financial organization or awareness of financial concepts related to Trading hub.

Nice-to-haves

• Experience with Java for converting legacy systems.
• Familiarity with financial trading systems and surveillance capabilities.