Lead Software Engineer - Scraping Job at Next Ventures, New York, NY

aXhoNlNCK0VsSmpEMHhuZnVrUmVlK1VVRmc9PQ==
  • Next Ventures
  • New York, NY

Job Description

Role: Our client is an innovative FinTech company and the market leader in providing data and business intelligence to help customers make faster and smarter investment decisions. They are looking for a Lead Software Engineer to drive and own their web scraping initiatives. This role will lead the design, development, and maintenance of scalable scraping solutions as part of their data technology team. The ideal candidate is an expert Python developer with strong experience in web scraping and related technologies. Responsibilities Provide effective technical leadership and hands-on technical mentorship to developers. Lead the design and development of web scraping applications and services, ensuring they are scalable, efficient, and meet performance requirements. Drive technical decisions, ensuring that best practices are followed. Provide leadership in applying design patterns and adhering to SOLID engineering principles, with a focus on reusability, modularity, scalability, and fault tolerance. Utilize hands-on experience to design, build, and support web scraping solutions, particularly using Python and relevant libraries (e.g., Scrapy). Promote a culture of continuous improvement and high-quality code delivery. Partner with the broader technology leadership team to ensure service reliability through testing and release procedures. Stay current with industry trends in web scraping, data technologies, and emerging tools. Identify opportunities for innovation and process improvement. Ensure compliance with security and firmwide architecture standards. Requirements Strong understanding of technical design patterns and SOLID engineering principles. Experience mentoring engineering teams, particularly in the context of data extraction and scraping projects. Expertise in Python development, particularly with web scraping libraries like Scrapy/Beautiful Soup. Proven experience in developing and maintaining large-scale web scraping solutions. Familiarity with C#/.NET technologies is a strong plus. Strong problem-solving skills and a proactive attitude. Strong understanding of API design principles and best practices. Experience with CI/CD pipelines and automated testing frameworks. Familiarity with cloud platforms (AWS/GCP/Azure). Experience with software development lifecycle tools such as JIRA, Confluence, GitHub, etc. Excellent communication and collaboration skills. This position offers comprehensive benefits and is eligible for an annual discretionary bonus. Fully remote candidates will be considered. Cannot provide Visa sponsorship at this time. #J-18808-Ljbffr Next Ventures

Job Tags

Remote job,

Similar Jobs

McKesson

Technical Product Manager (Boston) Job at McKesson

 ...McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being... 

Weida Freight System

Import/Export Specialist Job at Weida Freight System

 ...Role Description This is a full-time on-site role for an Import Export Specialist located in Houston, TX at Weida Freight System. The...  ...will be responsible for managing, export, import, and international trade activities on a day-to-day basis. Qualifications... 

Liga Puertorriquena Con

Handyman Job at Liga Puertorriquena Con

 ...Grado Tcnico en Plomera de Institucin Universitaria acreditada Licencia y Colegiacin Mnimo un (1) ao de experiencia como Handyman Mnimo un (1) ao de experiencia en Plomera Habilidad para leer y comprender instrucciones escritas y orales. Curso en ... 

MSP Hire, Inc.

Technical Support Representative Job at MSP Hire, Inc.

 ...they receive clear and effective solutions. If you enjoy helping others navigate technology and solving problems with...  ...and weekends as required.What You Bring 1-2 years of experience in IT support, help desk, or a related field.A strong focus on customer service... 

Louisville Dental Associates

Dental Office Manager Job at Louisville Dental Associates

 ...Job Description Job Description Office Manager Are you a natural leader who thrives in a fast-paced, team oriented environment? Do...  ...workplace culture while ensuring the smooth daily operation of a dental practice? If so we would love to meet you! We are seeking a...