Senior Data Engineer
Company: ComplexCare Solutions
Location: Nashville
Posted on: October 18, 2024
Job Description:
Overview: ComplexCare Solutionsis a leading technology company
that combines advanced cloud-based data analytics and data-driven
intervention platforms to achieve meaningful insight. Platform
require to ingest large amount of variety of data from various
clients. Timely and accurately ingestion of business data is utmost
critical for the success of the platform. You have the opportunity
to create configurable and robust data ingestion platform and work
on truly cutting-edge cloud and big data technologies.
Duties and Responsibilities:
- Work with the agile team to participate in agile ceremonies
like grooming, planning, standup, retrospective, demos
- Actively contribute to grooming, and standup, create & update
tasks estimate and status
- Design and develop modern data ingestion pipeline utilizing
tools like ADF (Azure Data Factory), Databricks, MS-SQL
- Extensively work on Azure Cloud Platform
- Write complex queries, stored procedures, functions, for
various job execution, manipulating data
- Create highly configurable design to apply various business
rules, filters, mapping based on various clients
- Work with data architects and business analysts to create a
logical data model and create DDL scripts for physical model
creation
- Read data files (flat, excel, csv, json etc) from sftp servers,
validate the data utilizing various business rules and
configurations
- Design and code various data architecture component like data
validation, cleansing, de-duping, Symantec layer
- Work on large data to ensure configurable ingestion of data,
dynamic rule & validation of data, cleansing, transforming and
loading into the data warehouse
- Design and implement data validation and quality checks to
ensure the accuracy and completeness of the data in the data
warehouse
- Perform performance of queries and data processing, identify
and resolve any issues looking at query plans, create appropriate
indexes, resolve dead locks and create table hints
- Understand data partition, performance,
multi-threading/processing of high volume data
- Participate in design discussions, data analysis, data model
creation etc
- Product quality design diagrams (using MS-Visio, Draw.io etc)
and documentations (MS-Work, Excel etc)
- Maintain compliance with ComplexCare Solutions policies,
procedures and mission statement;
- Adhere to all confidentiality and HIPAA requirements as
outlined within ComplexCare Solutions Operating Policies and
Procedures in all ways and at all times with respect to any aspect
of the data handled or services rendered in the undertaking of the
position; and
- Fulfill those responsibilities and/or duties that may be
reasonably provided by ComplexCare Solutions for the purpose of
achieving operational and financial success of the Company.
Job Requirements:
- Minimum of 10 years industry experience working in data &
reporting area, knowledge of healthcare data will be a
plus
- 10+ years working on data process/pipeline, ETL, Data Workflow,
Query Plans & Optimization
- 10+ experience in MS SQL, T-SQL, ETL Jobs
- 5+ years working on databricks, PySpark/SparkSQL, data frames,
unity catalog
- 5+ years' experience in writing query plans, indexes
etc
- 5+ years' experience working on Azure Cloud is preferred
utilizing ADF (Azure Data Factory), Azure Delta Lake, Azure SQL
Server, Data Sync, Log Insights and Analytics
- Experience working with Role based security at database, ETL
jobs, data exports level
- Experience with HIPPA and PHI will be a plus
- Ability to effectively communicate with internal and external
customers
- Excellent verbal and written communication skills
- Excellent computer proficiency (MS Office - Word, Excel and
Outlook)
- Must be able to work under pressure and meet deadlines;
and
- Ability to work independently and to carry out tasks to
completion following standard accepted practices
Education:
- BS degree in Computer Science or Computer Engineering,
Business, or equivalent experience.
Physical Demands and Work Environment:
- Sedentary work (i.e., sitting for long periods of
time);
- Exerting up to 10 pounds of force occasionally and/or
negligible amount of force;
- Frequently or constantly to lift, carry push, pull or otherwise
move objects and repetitive motions;
- Subject to inside environmental conditions; and
- Some travel (less than 10%) may be required for this position,
primarily for training and collaboration purposes.
Studies have shown that women and people of color are less likely
to apply for jobs unless they believe they meet every one of the
qualifications listed in a job description. If you don't meet every
qualification listed but are excited about our mission and the work
described, we encourage you to apply regardless. ComplexCare
Solutions is most interested in finding the best candidate for the
job and you may be just the right person for this or other
roles.
By embracing diversity, equity and inclusion we enhance our work
environment and drive business success. ComplexCare Solutions
strives to reflect the diversity of the communities where we
operate and of our clients and everyone whom we serve. We endeavor
to create a culture of inclusion in which our associates feel
empowered to bring their full, authentic selves to work and pursue
their professional goals in an equitable setting. We understand
that by fostering this type of culture, and welcoming different
perspectives, we generate innovation and growth.
ComplexCare Solutions is proud to be an equal opportunity workplace
and is an affirmative action employer. We are committed to equal
employment opportunity regardless of race, color, ancestry,
religion, sex, national origin, sexual orientation, age,
citizenship, marital status, disability, gender identity or Veteran
status. We also consider qualified applicants regardless of
criminal histories, consistent with legal requirement.
The Company maintains a drug free work environment for all of its
associates, which includes employees, contractors and vendors. It
is unlawful for associates to manufacture, sell, distribute,
dispense, possess or use any controlled substance or marijuana in
the workplace and doing so will result in disciplinary action, up
to and including termination of employment or the contracted
relationship.
Keywords: ComplexCare Solutions, Nashville , Senior Data Engineer, Engineering , Nashville, Tennessee
Didn't find what you're looking for? Search again!
Loading more jobs...