Watch all the Transform 2020 sessions on-demand here.
HackerRank today announced the launch of the Tech Talent Matrix, a tool that uses artificial intelligence informed by more than 7 million developer skill assessment tests. The Tech Talent Matrix is designed to help businesses attract developers by improving the tests they ask developers to take before being hired.
Through competitions and assessment tests, HackerRank helps more than 4 million developers measure and improve their skills, and it also works with more than 1,000 companies to assess skills of developers being considered for a job.
The matrix is meant to give businesses a way to measure the effectiveness of their developer hiring process — beyond metrics like the number of hires or how quickly they can fill a developer position.
Machine learning is used to help determine a healthy score distribution on assessment tests and to do things like measure the correlation between assessment test performance and feedback shared by developers after a test, VP of data science Sofus Macskássy told VentureBeat in a phone interview. Altogether, 150 million data points inform the matrix, which can tell a company how their test performs compared to those of peers in their industry or companies of a similar size.
June 5th: The AI Audit in NYC
Join us next week in NYC to engage with top executive leaders, delving into strategies for auditing AI models to ensure fairness, optimal performance, and ethical compliance across diverse organizations. Secure your attendance for this exclusive invite-only event.
Business assessments look at both an overall assessment quality score and a company’s outreach efforts to attract developers through channels like social media and invite email conversion rates.
To create an assessment score, HackerRank measures things like how long it took a developer to take a test, how often they had to run a piece of code, and coding languages used to complete assessments. The score is also informed by test design and direct feedback from developers about the test.
HackerRank will not initially make company assessment scores available to developers (which would give them an impression of high- or low-performing companies to help them decide whether they want to work for a company), but the company may revisit the idea next year after conversations with customers, a spokesperson told VentureBeat in a phone call.