Job Title: Data Engineer
Experience: 5–10 Years.
Location: Pan India
Joining Time: Immediate to 15 Days Maximum
About the Role:
Indus Net Technologies is looking for an experienced Data Engineer to design, build, and maintain robust data pipelines leveraging Databricks and Azure Cloud Services. The ideal candidate will have hands-on expertise in processing large-scale IoT sensor data from manufacturing equipment, ensuring data quality, integrity, and high performance across multi-plant operations.
Key Responsibilities:
Design and implement ETL/ELT pipelines using Databricks and PySpark.
Process and transform real-time IoT sensor data from multiple manufacturing plants.
Manage data storage, versioning, and optimization using Delta Lake.
Integrate data from diverse sources (SQL Server, JSON, CSV, APIs, etc.).
Write and optimize complex SQL queries and stored procedures for performance.
Implement data quality monitoring, testing, and CI/CD pipelines using Azure DevOps.
Collaborate closely with manufacturing and analytics teams to deliver actionable IoT data insights.
Top 4 Mandatory Skills:
Databricks & Apache Spark (PySpark) – Minimum 3 years of hands-on experience
Azure Cloud Services – Experience with ADF, Blob Storage, and DevOps
Python – Advanced proficiency with OOP concepts, pandas, and robust error handling
Delta Lake – Strong knowledge of data versioning, time travel, and optimization
Good-to-Have Skills:
Advanced SQL and stored procedure development
Experience in JSON data processing and schema handling
Git-based version control and CI/CD integration using Azure DevOps
Exposure to manufacturing or industrial IoT data patterns
Preferred Domain Knowledge:
Industrial IoT and time-series data management
Machine data and equipment performance monitoring
Multi-plant data integration and central data architecture
Data quality frameworks, downtime, and defect analytics
Qualifications:
Bachelor’s degree in Computer Science, Engineering, or a related field
4–6 years of proven experience in Data Engineering
2+ years of strong exposure to Databricks/Spark ecosystem
Azure Data Engineer Associate or Databricks certification is preferred
Soft Skills:
Excellent communication skills in English (written and verbal)
Strong analytical and problem-solving mindset
Collaborative and proactive approach with cross-functional teams
High attention to detail and commitment to data accuracy
