GET EMAIL UPDATES FROM POWERTOFLY
By signing up you accept the Terms of Service and Privacy Policy
BROWSE CATEGORIES
GET EMAIL UPDATES FROM POWERTOFLY
Rover

Improving Diversity In Engineering Through Blindfolded Code Reviews At Rover

Below is an article originally written by Adam Stewart at PowerToFly Partner Rover, and published on May 9, 2018. Go to Rover's page on PowerToFly to see their open positions and learn more.

One of the many problems facing the tech world is a lack of diversity. At a previous position in my career, I was in a diversity training program with 32 people. Thirty of them were white males. Now that I'm at Rover, I'm proud to say that diversity is something we spend a lot of time and resources addressing and it's reflected in the diversity of our team. We feel that implicit biases and subjectivity in the hiring process should be actively addressed and, to the extent possible while still evaluating a candidate as a whole person, removed from the picture.

Borne from one of these conversations was the need to make our hiring process as anonymous as possible to remove bias, and we started by looking at the take-home coding challenge. As part of our normal engineering interview process, we give candidates a challenge to work on independently and return to us. Our goal with the take home coding challenge is to solely review a candidate's coding and design abilities, independent of the candidate's past work and years of experience. In theory, this is the place in our hiring funnel that can be completely scored based on technical skills.

To accomplish this, we realized we needed to revise the take-home project to be anonymous in order to mitigate any implicit biases a reviewer may have. With the full support of management, I added tickets for this to my sprint schedule. This had an impact on the velocity of my normal work, but it was the right thing to do. I worked with the hiring managers and other interested people across several teams to design and review the new process to get a system that would work for everyone.

Process Change

Our old process

Before the anonymization project, when a candidate started the take-home challenge, we would create a new Github repository based on their Github username to maintain unique naming patterns. This project would be shared with the candidate for them to finish. Once the candidate was finished and had committed the last bit of code and documentation, they would notify the hiring manager.

The hiring manager would then get two engineers to review the code, and would add them to the Github repository. They would also add them to our hiring software as reviewers so they could input the results. This software sends out an email with deadlines and information. It also allowed the reviewer to see the resume, phone screen results, and some other information about the candidate in order to make a more informed decision. Once our internal review was complete, the results were submitted to the hiring manager who would make a decision on the candidate and if they should make it to the next step in the process.

Our new process

We decided there wasn't enough value in seeing the candidate's whole set of information (resume, name, years of experience, etc.) to justify letting any internal biases affect our decisions.

Therefore, we first removed the candidates Github username from the repository name. Now the projects only have a date and two initials as an identifier. This keeps the repositories unique without exposing the candidates choice of username.

Since some candidates leave identifiable information such as adding files based on their name, or signing their readme file, we needed to do something to prevent that. We now have instructions emailed to the candidate that inform them that they should not include any personal information in the project.

After the candidate is finished with the project, the hiring manager runs a short script against the candidates repository that replaces the candidate's username with the hiring manager's username. This preserves the log messages, which can be valuable, but obscures who actually did the commits.

The next difference in the process is that the hiring manager no longer adds the reviewers to the hiring software until after the review. The Github access is granted, and that is the only link the reviewer has into the candidate. The reviewer can now review the code as a standalone set of data without any bias.

The final change is that once the code review is complete, the reviewer submits the review in a new document that is sent to the hiring manager. The hiring manager can then copy and paste the review contents in the hiring software at this point, and complete this part of the interview.

Looking forward

This whole change in the process puts a little more workload on the hiring managers, but we felt it was important to implement. They now manually run an extra script to anonymize the Github repository, and they copy/paste the review into our hiring software. This only adds a couple of minutes to each candidate.

As a company, Rover is committed to hiring a diverse team. Diversity attracts more people and is a sign of a healthy and inclusive culture. It creates a more welcoming workplace. It can spark creativity and empathy, and allows the team to better help the people we serve. We are constantly trying to reduce biases in all aspects of our company culture, and an anonymized coding challenge is one small but necessary step towards that.

popular

How These Companies Are Celebrating Asian American and Pacific Islander Heritage Month

According to a recent study, anti-Asian hate crimes have risen 150% since the pandemic started. But these acts of violence are not new — they are part of a much larger history of anti-Asian racism and violence in the U.S.

That makes celebrating Asian American and Pacific Islander Heritage Month (which was named a month-long celebration in May by Congress in 1992 "to coincide with two important milestones in Asian/Pacific American history: the arrival in the United States of the first Japanese immigrants on May 7, 1843 and contributions of Chinese workers to the building of the transcontinental railroad, completed May 10, 1869") this year all the more important.

READ MORE AND DISCUSS Show less
Autodesk, Inc.

How Embracing What She Doesn’t Know Led Autodesk’s Arezoo Riahi to a Fulfilling Career in DEI

Arezoo Riahi isn't a big fan of the "fake it till you make it" approach. She'd rather ask for the help she needs and learn from it.

Autodesk's Director of Diversity and Belonging joined the design software company from the nonprofit world after a long career in connecting people from different cultures. While her work had been deeply rooted in DEI values, there were certain parts of the strategy-building aspects to her new role that she wasn't sure about.

"If you know it, show up like you know it. If you don't know it, you shouldn't fake it. And Autodesk didn't shame me for not knowing everything. They helped me, and the entire team, by providing the resources that we needed, bringing in outside expertise to help teach us when we were in new territory," says Arezoo, who has been at Autodesk for three years now, during which she's been promoted twice into her current role.

We sat down with Arezoo to hear more about her path into DEI work, what she thinks the future of that work must include, and what advice she has for women looking to build fulfilling careers, from knowing what you don't know and beyond.

READ MORE AND DISCUSS Show less
LogMeIn Inc.

Behind-the-Scenes: Sales Interview Process at LogMeIn

Get an inside look at the interview process for sales roles at LogMeIn, one of the largest SaaS companies providing remote work technology, from Michael Gagnon, Senior Manager of Corporate Account Executive Sales.

READ MORE AND DISCUSS Show less
Procore Technologies Inc

How Being an Open Member of the LGBTQIA+ Community Has Helped Procore’s Alex Zinik Overcome Imposter Syndrome at Work

Alex Zinik wasn't surprised that she started her career in education—she decided she would become a teacher when she was just in third grade.

She was surprised while working as a paraeducator in the school system and preparing to become a special education teacher, she discovered that it didn't feel quite right. "I didn't know if that's what I really wanted to do," she recalls.

So a friend suggested she take a job during her off summers at construction software company Procore. She thought this would be the perfect opportunity to try out this new challenge, and if she needed to, she could go back to the school district once the summer was over.

"Five summers later, I'm still here!" she says, smiling. "And I see myself here for many more years. I just fell in love with the company, the culture, and with the career growth opportunities I was presented with."

As part of our Pride month celebrations, Alex, currently the Senior Executive Assistant to the CEO at Procore, sat down with us to share how a common fear—the fear of being found out—underlay the imposter syndrome she felt when pivoting to an industry in which she lacked experience, and the anxiety she often felt before coming out to her friends and family about her sexuality.

Read on for her insight on overcoming negative thought patterns, being yourself, and paying it forward.

READ MORE AND DISCUSS Show less
CSL

The Outlook That Helps CSL’s Paula Manchester Invest in Herself and Her Team

If you told Paula Manchester that you weren't good at math, she wouldn't believe you.

"That's a global indictment," she says. "'I'm not good at math' implies that you don't have the ability to nurture that muscle. And then I'd ask what kind of math? There's a lot to math."

READ MORE AND DISCUSS Show less
© Rebelmouse 2020