Full-stack Data Engineer

About The Company The Battle of Giants is dedicated to addressing a fundamental question: Will a company’s strategy lead to sustainable growth? Our mission is to empower investors and corporate executives with the insights needed to assess a company's growth potential and capacity for innovation. In an era marked by rapid disruption and technological change, understanding and designing effective strategies is crucial for long-term success. We collaborate with organizations to diagnose their strategic health, ensuring that their teams are engaged and aligned in building strategies they believe in. Our ultimate goal is to facilitate the development of strategies that foster growth, innovation, and resilience, helping our clients stay ahead in competitive markets. About The Role As a Data Engineer at The Battle of Giants, you will play a vital role in designing, enhancing, and maintaining our ETL (Extract, Transform, Load) processes, which are essential for our analytical and investigative functions. Your primary responsibility will be to develop reliable and efficient methods for extracting data from diverse sources, including websites and APIs, both public and private. You will work closely with our team to identify superior datasets, improve data features for machine learning models, and structure data for optimal analysis. Your insights will directly influence the quality of reports and visualizations that communicate strategic insights to stakeholders. This role requires a proactive mindset, a problem-solving attitude, and the ability to work in an ambiguous environment where innovation and questioning assumptions are encouraged. Qualifications Proven experience in data engineering, ETL pipeline development, or related rolesStrong proficiency in Python, SQL, and data manipulation toolsExperience working with APIs and web scraping techniquesFamiliarity with data visualization tools such as Tableau or similar platformsKnowledge of machine learning features and data structuring best practicesExcellent problem-solving and analytical skillsAbility to learn new tools and technologies quicklyStrong communication skills and the ability to work collaborativelyExperience in handling large datasets and ensuring data accuracy and timelinessDegree in Computer Science, Data Science, or a related field is preferred Responsibilities Design, develop, and optimize ETL processes to support data analysis and reportingIdentify and implement reliable methods for web scraping and API data extractionEvaluate and incorporate new datasets to enhance investment and strategic insightsImprove data features for machine learning algorithms and predictive modelingStructure and format data to facilitate efficient analysis and reportingCollaborate with cross-functional teams to understand data needs and deliver solutionsEnsure data accuracy, integrity, and timeliness for all datasetsCreate reports and visualizations that effectively communicate insights to stakeholdersStay updated with emerging tools and best practices in data engineeringParticipate in troubleshooting and resolving data-related issues proactively Benefits Comprehensive health coverage including supplemental health benefitsFour weeks of paid time off to promote work-life balanceUnlimited sick days to support health and well-beingOpportunity to customize your workstation and technology setupEncouragement to dedicate time on Fridays for creative or community projectsSupportive environment that values personal growth and innovation Equal Opportunity The Battle of Giants is committed to fostering an inclusive and diverse workplace. We provide equal employment opportunities to all applicants and employees regardless of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, age, disability, or any other protected status. We believe that a diverse team enhances our ability to innovate and serve our clients effectively. All employment decisions are made based on merit, qualifications, and business needs.