Senior PySpark Developer
Infosys
Work from Office
Full Time
Min. 8 yearsJob Description
Senior PySpark Developer
Mandatory Skills 8+ years of IT experience. Strong hands-on experience in PySpark and Python. Expertise in Apache Spark, Spark SQL, DataFrames, and ETL Development. Strong SQL and database concepts. Experience with Hadoop Ecosystem (Hive, HDFS, YARN). Experience in Data Warehousing and Data Modeling. Hands-on experience with Unix/Linux. Key Responsibilities Design and develop scalable data pipelines using PySpark and Apache Spark. Build and optimize ETL/ELT frameworks for processing large volumes of structured and unstructured data. Develop high-performance Spark applications using Spark SQL, DataFrames, and RDDs. Work closely with data architects and business teams to define data requirements. Implement data quality, validation, and governance processes. Optimize Spark jobs for performance, memory management, and scalability. Integrate data from various sources including databases, APIs, cloud storage, and streaming platforms. Support production deployments and resolve performance bottlenecks. Mentor junior developers and participate in code reviews.Job role
Job requirements
About company
Similar jobs you can apply for
Software / Web DeveloperJunior AI Research Associate
Rooman TechnologiesWork from OfficeFull TimeFreshers only
Good (Intermediate / Advanced) EnglishTeam Leader
Canares Automation Private LimitedWork from Office
Part TimeFull TimeMin. 3 yearsGood (Intermediate / Advanced) English
Engineering Trainee
Hapgen Educational ServicesWork from OfficeFull TimeAny experienceBasic English
Quality Control Engineer
Structo Builders
Field JobFull TimeMin. 2 yearsBasic English
Quality Assurance Executive
Lattooland Private LimitedWork from OfficeFull TimeAny experienceBasic EnglishQuality Control Inspector
Kraft WoodField JobFull TimeAny experienceBasic EnglishYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 8 to 11 years are eligible to apply for this job. You can apply for more jobs in Bengaluru/Bangalore to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru/Bangalore at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru/Bangalore . Through apna, you can find jobs in 64 cities across India. Join NOW!