- Career Center Home
- Search Jobs
- Big Data Engineer Consultant II
Results
Job Details
Explore Location
Allstate
Bangalore, India
(on-site)
Job Type
Full-Time
Big Data Engineer Consultant II
The insights provided are generated by AI and may contain inaccuracies. Please independently verify any critical information before relying on it.
Big Data Engineer Consultant II
The insights provided are generated by AI and may contain inaccuracies. Please independently verify any critical information before relying on it.
Description
At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.Job Description
We are seeking a Data Engineer to support the design, development, and maintenance of robust data pipelines and infrastructure that enable data-driven decision-making. This role requires hands-on experience in Azure Fabric, Oracle SQL, and PySpark, along with a strong understanding of modern data engineering practices. The ideal candidate will collaborate with team members and stakeholders to deliver efficient, high-quality data solutions that support analytics and reporting initiatives across the organization.
Key Responsibilities
- Data Pipeline Development: Design, develop, and maintain ETL/ELT pipelines using PySpark, Oracle SQL, and Azure Fabric components to move and transform data from diverse sources.
- Data Integration: Support the integration of structured and semi-structured data across multiple systems, ensuring data consistency, quality, and performance.
- Cloud-Based Data Engineering: Leverage Azure Data Services (e.g., Azure Data Factory, Azure Synapse, Data Lake Storage) to implement scalable and reliable data workflows.
- Data Modeling & Querying: Write efficient SQL queries, perform data profiling, and assist in the development of logical and physical data models.
- Collaboration: Work with data analysts, BI developers, and data scientists to understand data needs and provide well-prepared datasets that support analytics use cases.
- Data Quality & Testing: Contribute to the implementation of data quality checks, error handling, and validation processes in data pipelines.
- Documentation: Maintain clear and accurate documentation of data workflows, transformations, and architecture components.
- Continuous Improvement: Identify areas for performance optimization and recommend improvements to pipeline efficiency, storage design, or processing logic.
Qualifications
- Bachelor's degree in computer science, Information Systems, or a related field.
- 3-6 years of experience in data engineering or a similar role.
- Hands-on experience with:
- Azure Fabric and Azure-based data services
- Oracle SQL (data querying, scripting, and performance tuning)
- PySpark (for scalable data processing and transformation)
- Solid understanding of ETL/ELT processes, data warehousing principles, and data lake architectures.
- Familiarity with data modeling, version control systems (e.g., Git), and CI/CD practices.
Primary Skills
Azure Service Fabric, Big Data, Big Data Engineering, Big Data Systems, Big Data Technologies, Data Engineering, Data Modeling, Data Science, ETL Processing, Extract Transform Load (ETL), Influencing Others, Oracle SQL, PySpark
Shift Time
Shift B (India)
Recruiter Info
Diksha Prasad
dprbd@allstate.com
About Allstate
Joining our team isn't just a job - it's an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. One where you can shape the future of protection while supporting causes that mean the most to you. Joining our team means being part of something bigger - a winning team making a meaningful impact.
The Allstate Corporation is one of the largest publicly held insurance providers in the United States. Ranked No. 84 in the 2023 Fortune 500 list of the largest United States corporations by total revenue, The Allstate Corporation owns and operates 18 companies in the United States, Canada, Northern Ireland, and India. Allstate India Private Limited, also known as Allstate India, is a subsidiary of The Allstate Corporation. The India talent center was set up in 2012 and operates under the corporation's Good Hands promise. As it innovates operations and technology, Allstate India has evolved beyond its technology functions to be the critical strategic business services arm of the corporation. With offices in Bengaluru and Pune, the company offers expertise to the parent organization's business areas including technology and innovation, accounting and imaging services, policy administration, transformation solution design and support services, transformation of property liability service design, global operations and integration, and training and transition.
Learn more about Allstate India here.
Requisition #: 1525416953
dz1rbepqf
Job ID: 80714569

Allstate
Insurance
Illinois
,
United States
The Allstate Corporation is the nation’s largest publicly held personal lines insurer. A Fortune 100 company, with $156.4 billion in assets, Allstate sells 13 major lines of insurance, including auto, property, life and commercial. Allstate also offers retirement and investment products and banking services. Allstate is widely known through the “You’re In Good Hands With Allstate®” slogan. Allstate was founded in 1931 and became a publicly traded company in 1993.
View Full Profile
More Jobs from Allstate
Represented Bodily Injury Adjuster - NY\/NJ\/PA (Remote)
New Jersey, New Jersey, United States
13 hours ago
Early Career Trial Attorney (Remote - Hudson Valley \/ Westchester County, NY)
New York, New York, United States
13 hours ago
Direct Sales Agent Specialist (1626)
Saint Petersburg, Florida, United States
13 hours ago
Jobs You May Like
Median Salary
Net Salary per month
$1,072
Cost of Living Index
23/100
23
Median Apartment Rent in City Center
(1-3 Bedroom)
$333
-
$851
$592
Safety Index
46/100
46
Utilities
Basic
(Electricity, heating, cooling, water, garbage for 915 sq ft apartment)
$19
-
$57
$32
High-Speed Internet
$7
-
$14
$10
Transportation
Gasoline
(1 gallon)
$4.50
Taxi Ride
(1 mile)
$0.45
Data is collected and updated regularly using reputable sources, including corporate websites and governmental reporting institutions.
Loading...
