hackajob is collaborating with Excella to connect them with exceptional professionals for this role. Lead Consultant Data Engineer Arlington, Virginia, United States, Remote Excella is a transformative technology firm that helps organizations unlock new possibilities. We believe the key to helping clients challenge the status quo and reach new heights lies in our talented people. That’s why we’re committed to developing talent and providing opportunities for career growth at every stage. Join our collaborative team dedicated to solving complex problems with sustainable solutions while building your future as a leader. At Excella, you’re empowered to make lasting impact, turning today’s challenges into tomorrow’s mission successes. Workplace locations look different for everyone. Excellians are a distributed workforce and whether you're working from your home office or a client site, we support a flexible work/life integration regardless of your location. We offer top of industry medical, dental, and vision benefits with multiple options to choose from such as an employer-contributed health savings account, infertility coverage, and orthodontia so you can select the plan that works best for you. Regardless of what stage of life you’re in, Excella wants to support you. We provide 8 weeks of Parental Leave, discounted pet insurance, and a Care.com membership with 3 back-up emergency child or elder care days annually - all available to you on your first day. Starting day one, every employee is bonus eligible and receives 15 days of paid vacation, 6 federal holidays, and 4 floating holidays. Doing your best work means having the best tools! Excella’s TechEleX program provides you with multiple options to suit your technology needs. Choose between a variety of Mac or PC devices, and to ensure your hardware remains current, at the end of a 3-year period Excella will replace your existing computer with a new model from the program. Plus, we’ll even give you the original device to keep for your personal use! With Excella’s Annual Internet Reimbursement benefit, all employees receive an additional $25 per month to help offset the cost of internet access. This initiative reflects our commitment to supporting you in staying connected and productive, no matter where you work. We'll invest in your career by providing 3 days of paid professional development every year, including an allowance for registration fees to attend classes, conferences, or obtain professional certifications. We encourage mindfulness and overall well-being through employee wellness events, a HeadSpace membership, as well as access to TalkSpace and mental health coverage through our medical plans. Overview Lead Data Engineers at Excella drive the architecture, development, and optimization of data solutions, ensuring they align with business goals and technical best practices. They take ownership of large-scale data initiatives, mentor team members, and provide strategic input on data platform decisions. Lead Data Engineers oversee technical delivery, ensuring data solutions are robust, scalable, and maintainable. Responsibilities Lead the design, development, and optimization of scalable data solutions. Define data architecture strategies and ensure best practices are followed. Oversee and guide the creation and automation of data pipelines and platforms. Establish and enforce data quality and governance frameworks. Collaborate with Architects, Product Owner, Data Scientists, and DevOps to align data solutions with business needs. Research and evaluate emerging data technologies and methodologies. Ensure seamless integration of data management solutions into client environments. Develop risk mitigation strategies and implement data recovery plans. Lead the development of data repositories, including data warehouses, data lakes, and operational data stores. Mentor and support the development of junior and senior team members. Qualifications 6+ years of experience in data engineering and related technical domains. Designed and built scalable, extensible data pipelines for production environments with strong expertise in SQL, Python, and PySpark. 2+ years of hands-on experience with Databricks, including development, data processing, and pipeline optimization in a cloud-based environment Hands-on experience with big data and distributed systems, Parquet, Delta Lake, HDInsight Extensive work with cloud-native data platforms and services, such as Azure Data Factory, Synapse, Azure Storage Accounts, Streaming Analytics, Azure Fabric Deep understanding of data lake architecture, secure and per