Software Engineer AI Coding Tasks

Askable is seeking skilled software engineers to contribute to the development of artificial intelligence coding tasks. This remote opportunity invites developers to leverage their expertise in existing codebases to create challenging assignments that will push the boundaries of current AI coding models.

About the Role

This unique role offers a performance-based remuneration structure. Successful completion and acceptance of each AI coding task will earn the engineer US$1,000. The platform supports an unlimited number of tasks, allowing motivated individuals to maximise their earning potential. The core of the work involves transforming real-world code changes from repositories into comprehensive coding problems designed to test and improve AI capabilities. Engineers will be instrumental in shaping the next generation of AI-powered development tools by identifying and crafting scenarios that are challenging for machines but solvable by experienced human developers.

The responsibilities for this position are centred around the creation and refinement of AI coding tasks. This includes:

• **Identifying and Proposing Tasks:** Engineers will draw upon their familiarity with specific codebases to propose a meaningful change or problem from a repository they know well. This proposal will form the basis of a new AI coding task.
• **Setting Up the Environment:** Once a task is approved, engineers will establish the necessary development environment on Askable's platform, replicating the repository's state prior to the proposed change.
• **Developing Solutions and Grading:** The engineer will then develop a correct solution to the problem posed by the task, along with robust grading mechanisms to automatically assess the performance of AI models.
• **Stress-Testing and Refinement:** A crucial aspect of the role involves rigorously testing the created task against various AI coding models. This includes attempting to "trick" the AI with incorrect or shortcut solutions to ensure the task is appropriately challenging and accurately evaluates model performance.
• **Iterative Improvement:** Feedback from reviewers will be incorporated to revise and enhance the coding tasks, ensuring their quality and effectiveness.
• **Continuous Contribution:** Upon acceptance of a completed task, engineers are encouraged to immediately begin working on new assignments, fostering a continuous cycle of contribution.

What They're Looking For

Askable is looking for seasoned software engineers with a proven track record. Essential qualifications include:

• A minimum of two years of professional software engineering experience.
• Demonstrated experience with code that has been merged into either a public open-source repository or a qualified private codebase, signifying real-world contribution.
• Proficiency in at least one of the following programming languages: Python, TypeScript, Go, Rust, Java, or C++.
• Solid practical experience with core development tools and technologies such as Docker, Linux, Git, and automated testing frameworks.
• Regular utilisation of AI coding tools, indicating an understanding of their current capabilities and limitations.
• Experience in crafting tests and defining evaluation criteria specifically for AI models.
• The ability to articulate technical changes and task requirements clearly and concisely.
• Availability to commit at least 10 hours per week to this role.
• Access to a secure personal or work computer capable of supporting the development environment.

This opportunity is well-suited for experienced software engineers in South Africa looking to contribute to the burgeoning field of AI development in a flexible, remote capacity. While specific remuneration can vary greatly based on the complexity of the tasks and the engineer's expertise, roles that involve AI development and testing are often highly valued. Employers in this space range from innovative tech startups to established software companies looking to integrate AI into their products and workflows. For individuals keen on advancing their careers in AI, roles like this can offer significant learning experiences and a pathway to more specialised AI engineering positions.

• 2+ years of professional software engineering experience.
• Code merged into a public open-source repository or a qualified private codebase.
• Strong in at least one of Python, TypeScript, Go, Rust, Java, or C++.
• Solid experience with Docker, Linux, Git, and automated testing.
• Regular use of an AI coding tool.
• Experience writing tests and evaluation criteria for AI models.
• Ability to explain changes clearly and concisely.
• Availability of at least 10 hours a week.
• A secure personal or work computer.