Frontend Code Evaluator - Expert

Other Jobs To Apply

<strong>About The Job<br><br></strong><strong>Mercor</strong> connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include <strong>Benchmark</strong>, <strong>General Catalyst</strong>, <strong>Peter Thiel</strong>, <strong>Adam D'Angelo</strong>, <strong>Larry Summers</strong>, and <strong>Jack Dorsey</strong>.<br><br><strong>Position:</strong> Frontend Engineer — Web Replication Preference Rater<br><br><strong>Type:</strong> <strong>Contract<br><br></strong><strong>Compensation:</strong> <strong>$90/hour<br><br></strong><strong>Location:</strong> <strong>Remote<br><br></strong><strong>Role Responsibilities<br><br></strong><ul><li>Render a reference page and two candidate replications side by side at desktop width. Judge which is the closer reproduction.</li><li>Diff layout fidelity in detail, including box model, typography, color, image handling, and overflow.</li><li>Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct.</li><li>Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid.</li><li>Write structured rationales for every judgment, ranking defects by importance in precise language.</li><li>Flag ties, ambiguous cases, and broken task items rather than forcing a preference.<br><br></li></ul><strong>Qualifications<br><br></strong><strong>Must-Have<br><br></strong><ul><li>3+ years of professional web development experience, primarily in frontend or full-stack work.</li><li>Fluency in hand-written HTML and CSS.</li><li>Working command of browser devtools.</li><li>Enough JavaScript to read scripts and understand DOM manipulation.</li><li>Comfort in a terminal for local server setup.</li><li>Strong written English and discipline to justify judgments.<br><br></li></ul><strong>Preferred<br><br></strong><ul><li>Prior RLHF, preference labeling, or model evaluation work.</li><li>Code review or technical assessment background.</li><li>Pixel-perfect design-to-code experience.</li><li>Web accessibility expertise (WCAG, ARIA).</li><li>Familiarity with LLMs' typical failures in codegen.</li><li>Web scraping or DOM parsing experience.<br><br></li></ul><strong>Application Process (Takes 20–30 mins to complete)<br><br></strong><ul><li>Upload resume</li><li>AI interview based on your resume</li><li>Submit form<br><br></li></ul><strong>Resources & Support<br><br></strong><ul><li>For details about the interview process and platform information, please check: any help or support, reach out to: support@mercor.com<br><br></li></ul><em>PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.<br><br></em>,<br><br>

Share Share
Apply Now →