See all roles

Security Engineer - AI Evaluator

Work from home Full-time role Hiring

Overview

Handshake is looking for experienced security engineering and offensive security professionals to support AI research through flexible, part-time contract work. This is not a traditional job — you'll draw on your hands-on expertise in penetration testing, threat hunting, malware analysis, and red team operations to evaluate AI-generated content and provide feedback that helps AI better understand real-world security workflows and attack techniques. This is an ongoing, project-based opportunity you can take on alongside anything else you have going on. Details

  • Use your domain expertise to create expert-level training questions and scenarios based on real security engineering and offensive security workflows
  • Review and evaluate AI-generated responses for accuracy and relevance to real-world penetration testing, malware analysis, and threat hunting practices
  • Provide structured written feedback to help improve AI model performance
  • Complete tasks at your own pace with no set schedule or minimum hour requirement

Qualifications

  • 3+ years of professional experience in security engineering or offensive security, in a role such as Security Engineer, Penetration Tester, Red Team Engineer, Malware Analyst, Threat Hunter, or Offensive Security Engineer
  • Hands-on experience with one or more of the following: Burp Suite, Nmap, Wireshark, Metasploit Framework, BloodHound, Impacket, Nessus, or Hashcat
  • Strong written communication skills, attention to detail, and the ability to work independently in a remote, asynchronous environment

Application Process

  • Create a Handshake account
  • Upload your resume and verify your identity
  • Get matched to a project

Work authorization information F-1 students who are eligible for CPT or OPT may be eligible for projects on Handshake AI. Work with your Designated School Official to determine your eligibility. If your school requires a CPT course, Handshake AI may not meet your school’s requirements. STEM OPT is not supported. for more information on what types of work authorizations are supported on Handshake AI. Job Type: Contract Pay: Up to $80.00 per hour Work Location: Remote Apply tot his job Apply To this Job

You might like

US_East | Cyber Security Engineer _L3

Work from home Full-time role

Infrastructure & Security Engineer

Work from home Full-time role

Intermediate Software Security Engineer

Work from home Full-time role

Principal Information Security Engineer, Identity Security Engineering

Work from home Full-time role

IT Security Engineer- Remote – United States

Work from home Full-time role

Remote Penetration Tester

Work from home Full-time role

Penetration Tester- Contract (Remote) at Fixpoint Remote

Work from home Full-time role

Penetration Tester (REMOTE)

Work from home Full-time role

[Remote] Senior Analyst, Cyber Security GRC (Penetration Tester)

Work from home Full-time role

Penetration Tester | Upto $2150 Part-time

Work from home Full-time role

[Remote] Sales Development Representative | Netherlands | Remote

Work from home Full-time role

Creative Director, Brand Design (US, Remote)

Work from home Full-time role

Payroll Manager (Remote in Texas)

Work from home Full-time role

Tax Analyst, Production Tax

Work from home Full-time role

Technical Business Analyst - LMS/EdTech

Work from home Full-time role

Admin & Operation Coordinator (Japanese-English Bilingual) — Remote, Eastern Time

Work from home Full-time role

Remote Electrical Engineer (building power systems)

Work from home Full-time role

Junior Mobile Developer

Work from home Full-time role

Experienced Customer Service Representative – Remote Opportunity with arenaflex

Work from home Full-time role

Experienced Customer Service Representative – Airline Industry

Work from home Full-time role