
"How E-Discovery Software Is Helping Battle COVID-19" - Robert Ambrogi
Below is an article originally written by Robert Ambrogi and published by Above the Law on June 29, 2020. This article includes information about PowerToFly Partner Relativity. Go to Relativity's page on PowerToFly to see their open positions and learn more.
The response contrasts with the legal profession's slow pace of adoption of cutting-edge AI technology.
Artificial intelligence software developed to help litigation attorneys get more quickly to the core of a case is now showing promise in helping medical researchers fast-track their inquiries into how to treat COVID-19.
At the University of Waterloo in Ontario, Canada, e-discovery pioneers Maura R. Grossman and Gordon V. Cormack have found a new use for machine-learning technology they developed to help attorneys more quickly sift through large collections of discovery documents — helping medical staff more quickly search massive databases of COVID-related clinical studies.
Meanwhile, data scientists and product managers at e-discovery company Relativity are employing several of their technology tools for the similar purpose of helping medical researchers more quickly review data sets of journal articles and medical literature with the goal of better equipping them to battle COVID-19.
In the Waterloo case, Grossman and Cormack are well known in the e-discovery field for their development of a technology-assisted review tool that uses a continuous active learning protocol. Of the various TAR or predictive coding tools on the market, theirs has been scientifically demonstrated to deliver the best results.
When the coronavirus crisis hit, Grossman, formerly e-discovery counsel at Wachtell, Lipton, Rosen & Katz in New York and now research professor and director of the Women in Science Program in the school of computer science at Waterloo, and Cormack, professor at the computer science school, had already been dabbling in the use of TAR to research health topics, she told me recently.
They saw a process that had many parallels to law, in that expensive medical researchers were spending large amounts of time reviewing hundreds or thousands of clinical studies, just as expensive lawyers spend large amounts of time reviewing documents in discovery.
Seeing an opportunity to help, they began working with the knowledge synthesis team at St. Michael's Hospital in Toronto, on behalf of the Canadian Frailty Network and Health Canada, to automate literature searches related to COVID-19.
The goal, as described in an article posted by the computer science school, was to help the team quickly identify clinical studies that have evaluated the effective and safety of various measures to keep nursing facilities safe, as well as treatments for patients with COVID-19.
Using their CAL technology, Grossman and Cormack have been able to help St. Michael's researchers complete in two weeks reviews that would typically take a year or more.
"Searching and finding studies for systematic reviews has traditionally been a time-consuming and laborious process that uses keyword search, followed by manual screening of abstracts, and finally full papers," Grossman said in the article. "We are instead training a machine learning algorithm to perform the initial steps in this task."
Analyzing COVID-19 Data
At e-discovery company Relativity, data scientists and product managers likewise saw a role for their technology and skills in helping in the fight against COVID-19. Recently, I discussed Relativity's response with Rebecca BurWei, senior data scientist; Andrea Beckman, director of product management; and Trish Gleason, product manager.
They were prompted to act after the White House Office of Science and Technology Policy released a massive dataset of COVID-19 medical research and issued a call to action to the tech community to develop text- and data-mining techniques to help scientists use the data to answer high-priority questions about COVID-19.
The tech community was encouraged to submit tools through Kaggle, a machine learning and data science community owned by Google Cloud, so that the tools would be openly available for researchers anywhere in the world. Kaggle sweetened the request with a $1,000 award for the tool that best met the project criteria.
Relativity responded using its existing AI and text-mining tools. Specifically, it offered four ways in which its technology could assist in facilitating the review of the data:
Elimination of duplicates. Deduplication is a task familiar to any e-discovery attorney, eliminating duplicate and redundant copies of email messages and other documents, in order to enhance the effectiveness of the AI software. When Relativity staff learned from the Kaggle forum that the COVID-19 researchers were seeing the same articles come up repeatedly, they saw a role for their deduplication technology. Using Relativity's Textual Near Duplicates and Repeated Content Identification tools, they reviewed the dataset and identified over 4,000 duplicate articles and a handful of commonly repeated phrases.
Tagging studies by language. Because the dataset included literature from throughout the world, articles were in many languages. Relativity used its Language Identification tool, which can identify text from 100 languages, and was able to tag over 52,000 COVID-19 journal articles by the language in which they were written. Relativity provided this language-tagged dataset to the Kaggle community, earning praise from a Kaggle community leader for having created a "great dataset."
Better keyword search of risk factors. Relativity's Conceptual Analytics uses a machine learning methodology called latent semantic analysis to extract insights and patterns from document data. Based on this technology, Relativity used keyword expansion to find concepts related to cancer and chronic respiratory diseases as risk factors for COVID-19. With those concepts, it was able to find 98 relevant journal articles that would otherwise have been missed.
Identifying pediatric patients. A goal of the Kaggle community's AI-powered literature review was to auto-fill summaries of COVID-19 journal articles, so that public health experts could decide quickly whether they needed to read the full article. Relativity contributed to this project by identifying and summarizing Spanish journal articles that involved asymptomatic pediatric patients.
Relativity's data scientists first used regular expression searches to filter down to a small number of relevant articles, then they experimented with new AI techniques not currently available in the e-discovery product, such as modern vectorizers and question-answer techniques, to automatically extract the ages of the study participants.
Rewarding Use Of Tech
For Grossman and Cormack at Waterloo and the product team at Relativity, using their e-discovery skills to help with COVID-19 research has been rewarding.
"What was most rewarding for me was the community angle and being able to help out during this crisis," said Relativity's Andrea Beckman. "We have a strong community in e-discovery, but here we got to join a different group and be part of everybody coming together in tackling a critical challenge."
Grossman drew a contrast with the legal profession's slow pace of adoption of cutting-edge AI technology such as TAR, due in part to its fear of losing the billable hour.
"Here we're in an area where the incentives are exactly the opposite, where there is receptiveness to something that will cut time and cut costs," she said. "It's refreshing to work in an area where the reception capacity and adoption rate is very different."
_______________________________________________________________________________________________
Robert Ambrogi is a Massachusetts lawyer and journalist who has been covering legal technology and the web for more than 20 years, primarily through his blog LawSites.com. Former editor-in-chief of several legal newspapers, he is a fellow of the College of Law Practice Management and an inaugural Fastcase 50 honoree. He can be reached by email at ambrogi@gmail.com, and you can follow him on Twitter (@BobAmbrogi).
Want to join the engineering teams at Workiva? Learn more about them!
💎Want to know what engineering teams are like at Workiva? Watch the video to the end to find out!
📼 Engineering teams at Workiva are constantly hiring. Marie Yue, Senior Engineering Manager at the company, tells you what they look for in a candidate and what the dynamics of teamwork are like.
📼 The typical path in the engineering teams at Workiva is that you grow into a senior, and then you move into a lead role. From there, there are a few different tracks that you can take depending on your interest. You can become a staff engineer, an architect, or even an engineering manager. What are you waiting for to apply?
📼In the engineering teams at Workiva every member should feel empowered to do their job effectively. For this, each has to understand how the work they do day to day solves customers’ problems. Managers will always seek to be aware of members’ career path aspirations so that they can look for opportunities and projects to help each person reach the next step in their career.
Engineering Teams At Workiva: A Safe Space
Marie Yue’s team is a safe space for people to make mistakes and ask for help, and each member feels a sense of belonging and inclusion. She wants to make sure that everyone is individually empowered to lead and make decisions. For this, the team has regular meetings where they do fun things like play virtual games or eat lunch together, and they also like to re-review and add to their team working agreement once a quarter.
🧑💼 Are you interested in joining Workiva? They have open positions! To learn more, click here.
Get to Know Marie Yue
If you are interested in a career at Workiva, you can connect with Marie Yue on LinkedIn. Don’t forget to mention this video!
More About Workiva
Workiva was founded to transform the way people manage and report business data with various collaborators, data sources, documents, and spreadsheets. Today, people all over the world use their platform to seamlessly orchestrate data among their systems and applications for transparent and trusted connected reporting and compliance. At Workiva, they are innovative in everything they do—from how they build their software, to how they serve their customers, to how they treat their employees.
Careers in Web Development: Which One's For You?
We all have our favorite websites– the ones we frequent, bookmark, and recommend to others. You might even enjoy some website features so much that you’ve found yourself wondering why they aren’t more popular. Or maybe you’ve experienced times where you were frustrated with a website and wished you could add features or even design your own!
If you’ve ever found yourself intrigued at the prospect of designing and developing your own websites, then a career as a web developer might be just for you!
As a web developer you would be responsible for coding, designing, optimizing, and maintaining websites. Today, there are over 1.7 billion websites in the world and, in turn, the demand for web developers is on the rise. In order to figure out what kind of web development work best suits you let’s start with an introduction to the three main roles in web development that you can choose from.
The Three Types of Web Development Jobs
Front-End Web Development: The Creative Side
Think of front-end development as the décor of a house. The color scheme, furniture, manicured lawns, and overall aesthetic. In terms of a website, front-end development is laser-focused on the appearance of a website and its presentation on different devices. If you’re considering a role in front-end development, it’s important to learn programming languages such as HTML, CSS, and JavaScript. These three languages go hand-in-hand. HTML allows you to create user interface elements, CSS helps you with stylistic elements, and JavaScript allows you to incorporate online tools and connect your website to back-end functions.
In addition to programming skills, front-end developers need to be detail oriented, creative, willing to keep up with the latest trends in web development, cyber security conscious, and geared toward user-friendly designs. The median salary for a front-end developer can reach well into the $90,000 to $100,000 range.
Back-End Web Development: The Logical Counterpart
While a house can be beautifully decorated, it’s incomplete without a solid foundation and efficient infrastructure. Similarly, a well-designed website depends on logical and functional code to power the features of that website. Back-end web development is code-heavy and focused on the specifics of how a website works. If you enjoy the analytical challenge of creating the behind-the-scenes code that powers a website, then back-end development is for you.
Since this role is more code-heavy, it’s important that you learn numerous programming languages and understand algorithms and data structures. Some languages that are essential to back-end development are Ruby, Python, SQL, and JavaScript. Back-end developers also ensure that users can successfully retrieve and access data. This requires creating and using APIs (Application Programming Interfaces) which act as messengers that relay data related requests. Additionally, developing the code for the inner workings of a website also requires back-end developers to be conscious of the user interface features designed by front-end developers and to internally mitigate potential security risks. Due to the increased technical aspect of this position, back-end developers normally earn higher salaries than front-end developers. The average median salary for this role is around $118,000 per year.
Full-Stack Web Development: A Little Bit of Everything
A full-stack developer is essentially the Jack (or Jill)-of-all-trades in web development. Full-stack developers need to be knowledgeable about both front-end and back-end roles. This does not necessarily imply that you would need to be an expert in both roles, but you should fully understand the different applications and synergies they each imply. In order to work in this position, you will need to know the programming languages used by front-end and back-end developers. In addition to these languages, full-stack developers also specialize in databases, storage, HTTP, REST, and web architecture.
Full-stack developers are often required to act as liaisons between front-end and back-end developers. Full-stack developers need to be both problem solvers and great communicators. The end goal for a full-stack developer is to ensure that the user’s experience is seamless, both on the front-end and on the back-end. In return, you can expect to earn a median salary of $100,000 – $115,000 a year for this role.
Taking the Next Step
Web development is both in-demand and lucrative! All three roles described above contribute to specific aspects of web development and the scope of each one can be customized to the industries and positions you feel best suit you. Regardless of which role you choose, all of them need a foundation in programming.
To gain the programming skills needed in each role, you can enroll in courses or learn independently. Coding bootcamps are a great way to boost your skillset quickly and efficiently.
Click here for some of our highly rated programming bootcamp options! Make sure to check out the discounts available to PowerToFly members.
Clyde’s Joseph Arquillo on the 6 Things Leaders Need to Do to Build Inclusive Spaces
Joseph Arquillo doesn’t work in Human Resources — he works in People Operations. And the distinction matters.
“It was named ‘human resources’ because it saw humans as resources, utilized for certain tasks or behaviors. But that’s not really what it’s about,” says Joseph, who is a Senior Manager of People Ops at Clyde.
“Calling it ‘people ops’ adds back what you lose with ‘HR.’ My philosophy is that I am there to support you. I am there to work with you, empower you, and enable you so you can be your best self.”
For Joseph, a key element of helping employees become their best selves is making sure that the workplace, whether in-person or virtual, is an inclusive space for all. That doesn’t happen by accident — it requires a dedicated DEIB strategy and leaders who are committed to asking hard questions of themselves and others.
We sat down with Joseph to hear more about his professional journey, and the practices of leaders who create environments where everyone feels included.
More Than Just a Number
As a college freshman, Joseph planned on sticking with liberal arts when it came to choosing a major. But then he took a class in Boston College’s School of Education, and loved its holistic approach to applied psychology.
This inspired him to switch his major to psychology and human development, and select minors in political science, and management and leadership, where he enjoyed learning about organizational psychology.
After graduation, he explored the consulting space to put theory into practice, but found out during an internship at a multinational consulting firm that finance or accounting weren’t the places he wanted to build his career.
“Since Big Four companies have 250,000 employees, you become just a number,” he says of the experience. “It wasn’t my cup of tea. Too corporatized.”
That kicked off Joseph’s interest in startups.
“It’s always fun to get in the weeds! One thing that’s very interesting to me is a challenge,” he says. “When you’re helping a company like Clyde grow and scale, joining when they’re at a Series B and helping them get to the next level, you really get to focus on the interaction between people, process, and product,” explains Joseph. “You need to hire the right people to work towards increasing efficiencies in all areas, but also make sure that we’re enabling them to create a strong product.”
6 Keys To Building Inclusive Spaces as a Leader
Across the different industries and companies that Joseph has worked in, he’s identified the behaviors that create truly inclusive environments — as well as those that discourage them.
Here’s what he’s seen:
- First, recognize your own privilege. “If you’re a man, you have privilege, even if you’re a gay male. If you are a white woman, you have racial privilege. It’s really important that you’re cognizant while you interact with somebody how they might interpret the interaction based on your identity.”
- Leaders should always speak last. This is important always, but especially in in-person spaces, where it might seem even more nerve-wracking to speak up in a crowd, says Joseph. “You want to make sure you’re creating that space for employees who aren’t as senior to feel comfortable voicing their thoughts.”
- And, leaders should use check-ins liberally. “You need to ask yourself how you’re supporting your employees. Are you checking in on them as people before you ask about certain tasks? You want to foster a workplace where employees from all walks of life can feel supported,” he says.
- DEIB isn’t just about adding new initiatives — sometimes it’s about removing barriers. “You need to remove unnecessary bias,” explains Joseph. “That can mean making sure you have appropriate policies and practices that don’t hinder people depending on who they are or where they live.”
- Maximizing participation requires planning with a diversity lens. Joseph has helped the Clyde team gather together and bond as a group. Along the way, he’s been careful to consider physical and psychological safety for everyone involved. “For instance, if you’re doing an event, do you have someone who’s not drinking? Have you set up the environment for people who might have a physical disability, or carefully planned the flow of activities for people who might be neurodivergent?”
- Saying you want to be better isn’t enough — articulate actions you will take. “Pride is a great example,” explains Joseph. “Yes, June is a time to celebrate. But it’s also a time to march. And beyond that, how do you show up and celebrate with the LGBTQIA+ community throughout the year?”
Embracing the Unknown
If you visit Joseph’s LinkedIn profile, you’ll see his personal motto: “Without challenge, change, and a bunch of unknowns, it’s no fun.”
That belief has led him to study what he’s passionate about, to take on new and exciting roles at growing startups, and now, at Clyde, to help formalize what world-class people operations looks like at a fast-growing company.
“I view myself as a connector that really empowers people, challenges teams, and helps drive us towards what I consider to be an improved future,” he says. “I feel like it’s my responsibility to be the chief advocate for each of our employees, and remove any barriers in the way of their growth.”
Want to learn more about what opportunities Clyde offers? Check out their open roles!
Navigating Mid-Career Pivots and Finding a Company Where You Can Show Up Authentically
Insight from SoftwareONE’s Jeff Cannon and Chris Lecosia
SoftwareONE’s Jeff Cannon Business Development Executive US) and Christopher Lecosia (Senior Consultant) share a similar adventurous and brave spirit, which has led to a long trajectory of creative experiences for both of them. From taking care of two new puppies to backpacking across Europe — neither of them back down from a challenge.
As members of the LGBTQIA+ community, Jeff and Chris spent a large portion of their careers fighting for inclusive workplaces where they feel a sense of belonging, and opportunities to use their experiences to serve people, no matter what career stage they’re in. And they’ve both recently found that in the global provider of end-to-end software and cloud technology solutions SoftwareONE.
We sat down with Jeff and Chris to hear their stories on how they navigated mid and late career changes and their journey to finding a company where they felt valued. Keep reading to the end for four major tips on how to successfully pivot careers.
The Journey to SoftwareONE
Jeff Cannon was born in Tacoma, Washington, but considers both Texas and Georgeia his home. After graduating from college with a bachelor's degree in English and History, “I wanted to go to graduate school for history,” he explains. But upon arrival, he realized graduate school was not the right path for him, so he packed his backpack and set out for a trip through Europe instead.
This adventurous spirit led him back home to pursue exciting challenges, such as opening a hotel in Austin, working as a flight attendant in New York and Hawaii, and eventually pursuing a sales career at Dell. “I was an account executive for large university systems and large K-12 systems providing information technology to students to be able to further their education. It really fit in with my mantra around how important education is in society,” Jeff explains.”It's kind of my thing.” But after nearly 20 years at the company, he decided to look for new opportunities. “I was tired of doing the same thing all the time.” Enter SoftwareONE.
“This was an opportunity to do something completely different and take the information that I learned and use it to help build a practice that can accomplish some of the same things,” Jeff explains. He joined the company as a Business Development Executive Executive where he works to build the company’s education practice within the public sector in the United States.
SoftwareONE is a company where Jeff can thrive professionally and personally. He specifically cites the company to be people-first, which his coworker Christopher Lecosia agrees with. “SoftwareONE is a place where you can thrive as an employee, and where your creativity can flourish,” says Chris.
SoftwareONE is a leading global provider of end-to-end software and cloud technology solutions, with headquarters in Switzerland. The company itself prioritizes people as their “greatest asset” and advocates for life-work harmony. Their company’s core values are Employee Satisfaction, Customer Focused, Speed, Passionate, Integrity, Humble and Discipline, to name a few, and they ensure that they have “a welcoming – and constantly evolving – work environment for all”, no matter the racial, ethnic, religious, sexual or other preferences.
Christopher works as Senior Consultant for SoftwareONE. He entered the field of IT in 1974. “Back then it was called data processing,” he jokes. “But I kind of fell into IT consulting.” He enrolled in college as an accounting major, but quickly realized that was not the path for him. “I drove into the parking lot of this college for the first day and I got very scared,” explains Chris. “I turned around and went home and I found a job.” And he was able to pursue jobs that allowed him room to change and grow with the market. He began as a systems programer and, progressively, he scaled to managerial data processing roles at multiple software companies, including IBM. He played a key role in leading and growing software asset management programs, directing support for configuration and asset management, and serving as a senior project manager for multiple teams in his previous companies.
His successful 40+ year-long career led to the start of a well-deserved retirement. “I turned 65 last October, and I thought, ‘okay, I think I’ve had enough,’ and I decided to retire in full.” But his retirement was short-lived. “A few months before I retired, [my company] had put out an RFP to the street, which SoftwareONE responded to, and I'll never forget,” says Chris. “I was hearing them respond to me and I thought, ‘Wow, these people know what they're talking about. They're really sharp and I really believed in the value that they could bring.’” So when he was offered a position as a Senior Consultant, he didn’t think twice about coming out of retirement. “In November, a recruiter from SoftwareONE called, and I started in January of 2022.”
All-Around Authenticity
Changing jobs after working for a company long-term can be risky, especially later in your career. But both Jeff and Chris agree that the benefits of working at a company like SoftwareONE are well worth the risk. And for the first time, they’ve felt like they can show up as their full, authentic selves at work.
Jeff recalls past workplaces that, when push came to shove, “had an undercurrent of non-acceptance.” This undercurrent brought many challenges, but he credits them for his confidence today. “I have no issues whatsoever showing up originally as myself. And at SoftwareONE, everybody's been really lovely.” Even remotely, he finds ways to connect with his coworkers, and he feels like he can do so authentically.
Chris reiterates this in his own trajectory at SoftwareONE. “When I started, my Regional VP asked me for a bio. In my bio, I talked about my husband and my two dogs and how long we've been together. That got sent out to everybody in the organization. So when I onboarded, everybody already knew,” he explains. “It was the first time in 65 years that, right from the get go, there was no pretense at all as to being something different than I am. And that's how I came out at SoftwareONE. It was good to do that. I feel truly authentic.”
Advice for Mid-Career Pivoters
Both Jeff and Chris have successfully pivoted roles and companies later in their careers. They offer four tips to consider before making the jump to a new role or joining a new company.
1. Find a place that values service to the client. “Have the mindset of service,” says Chris. “ I'm a service oriented person and part of being of service is to share my experience, strengths, and hope with other people. Whether that's on a, social, spiritual, mental level, or on a professional technical level, this helps bring growth to you, and to the company you’ll work for.” Jeff shares that, “with this mindset, we see the challenges that customers face, so we're able to better articulate to customers what our value proposition is. We can help clients achieve their goals, and everything comes a lot more easily and naturally.”
2. Believe in what you have to offer. Chris and Jeff share that aligning with the company’s mission is another key aspect to consider before changing companies. “I never thought that anybody would want to hire me at 65 years old,” Chris shares. “I had been in my former job where I saw many opportunities that I thought I was perfect for, in terms of advancement, but I wasn't given those opportunities because of my age. I started to feel dried up a little bit. When I got the offer at SoftwareONE, I felt I really wanted to come back, be of service, keep my brain sharp, and do something. I do believe I have something to offer to many clients, as well as colleagues. And that's what made me make the move.”
3. Think of the experiences you bring to the table. Jeff shares how he transferred his knowledge to his new role. “I was able to take everything that I had learned about building an organization and bring it over to a company that needed that expertise specific to the United States. Being able to have the opportunity to do some of that background work and build on alliances has been, and continues to be, a great opportunity.”
4. Find a workplace that prioritizes diversity. “Each one of us brings a certain set of characteristics with us that sit well with our clients,” explains Chris. “The diversity we bring to the company — whether it be age, gender, color, educational background, intellectual capacity — all of that color makes us more relatable to our clients and our customers.” This leads to the company’s overall success.
SoftwareONE is constantly looking for dynamic employees like Chris and Jeff. Check out their company page to find out more about their roles!