by Amber Thomas

Women only said 27% of the words in 2016’s biggest movies.

1*92SrZzQkJAqwJoHu1xPneQ
Image by: Animoplex

Movie trailers in 2016 promised viewers so many strong female characters. Jyn Erso. Dory. Harley Quinn. Judy Hopps. Wonder Woman. I felt like this could be the year for gender equality in Hollywood’s biggest films.

I was wrong.

And I don’t make this statement lightly.

As a scientist, I turn to data to answer questions I have about the world. And I’ve got the data to back up my claim. In fact, you can have the data, code, and resulting data visualization that I made trying to better understand this topic. But first, let me tell you how I became so interested.

It all started when I went to see Rogue One: A Star Wars Story. All promotional materials for the movie indicated that Jyn Erso (played by Felicity Jones) was the main character. I mean, just look at the poster.

1*wEaxUjOocqR_ObtsKJaz0w

When your picture is several times larger than everyone else’s, you’re probably the main character.

What I didn’t notice at first was that Jyn is the only woman on that poster.

I went into the movie theater expecting to see men and women fighting side by side. I left feeling certain that I could count every female character from the movie on one hand. While Jyn was the main character, I was profoundly aware that she was often the only woman in any scene.

It felt strangely familiar to have a lead female character be so outnumbered. Then I realized that Jyn and Princess Leia suffered the same inequality 39 years apart. I was overwhelmed with a need to know exactly how female representation in Star Wars movies has changed. But it seemed unfair to compare movies made today with movies made decades ago.

So instead, I decided to look for female equality across the Top 10 Worldwide Highest Grossing Films of 2016. They were:

With so many powerful women in these films, some of them must be gender-equal, right?

The Data

Now that I decided what I wanted to investigate, I needed to figure out how to do it. Similar data exploration projects have focused on dialogue or screen-time equality. Both seemed like good options, but I wanted the ability to report on equality at the movie and character level.

In the end, I decided to explore the movies’ dialogue. This choice gave me the ability to focus on characters with an active role in the story and to cut non-speaking characters from my analysis.

Luckily for me, dedicated movie fans often transcribe a movie’s dialogue and make it freely available online. If I couldn’t find a transcript, I used closed-caption files instead. For those, I re-watched the movie and manually assigned characters to their spoken lines.

This process was a labor of love. It was time consuming, but I have no regrets.

Analysis

Once I had all of the transcripts, I just needed to read the .txt files into R and separate the characters from their lines. For the Rogue One transcript, that process looked like this:

Now that I had a data frame with both Character and Words columns, I had to assign genders to each Character. To remain consistent with my categorizations, I came up with a few simple rules:

  1. When possible, assign gender according to the pronouns that other characters use. For example, if a character is referred to by others as “he” or “him”, then he is categorized as “male”.
  2. If there is no pronoun used throughout the movie but the character is named or credited (on IMDB), use the gender of the actor or actress. Note that the gender of an actor or actress was assumed based on publicly available information as of January 2017.
  3. If no pronoun is used for the character and the character is not named or credited, refer to the closed captions. Sometimes they will identify the character that spoke.
  4. If all else fails, make an educated guess based on the character’s voice.

I’ll be the first to say that these methods are not perfect. In fact, here are some caveats:

  1. If a male character was voiced by a female actress (or vice versa) and the character was never addressed by other characters using pronouns, he may be incorrectly labelled. (I don’t think this happened, but anything is possible.)
  2. Voices that are not associated with a physical embodiment of a character (e.g., the voice of a computer) were categorized according to the gender of their voice actor/actress.
  3. I can never really know the gender of any character, but I’m using the cues and information that I have at my disposal.

Again, I am far from infallible, so if you caught a mistake on my part, please let me know.

So now I just needed to count the number of words spoken by each character. Again, I was able to do this in R using the dplyr and stringi packages.

It’s worth noting that I included every speaking character in this analysis. So yes, every stormtrooper who shouts a simple “Wait, stop!” before getting shot is included.

1*Nix-DNJovl_3XwRVmJPc8Q
Spoiler Alert: The stormtroopers in Rogue One are all voiced by men.

Data Visualization

I had my data. Unfortunately, tables upon tables of word counts and character names don’t give anyone much insight. Like any good data exploration project, it was time to visualize my results. I had to work through a few iterations before I found the best one.

Scatterplots and bar charts both masked characters with small roles.

1*79391ccZ2PRJ3bUjdtzOHA

A simple bubble chart was better but it became difficult to identify individual characters. It was also challenging to understand movie-level statistics.

1*ztI4yRBsYS7iKaJqe6D8PA
Which bubble is which?!

In the end, I decided to learn enough d3.js to make an interactive graphic. Here, each bubble represents a character, and the bubble’s area is scaled based on the number of words spoken. Female and male bubbles can be separated for better insight. The stacked bars below indicate movie-level information.

1*MH6WhQJc64Sy_ASXfSi9pA
Full interactive version here

Go ahead, check out the full interactive version.

Interested in exploring the raw word-count data for yourself? I’ve made all of the data and code used to generate these visualizations open source. It’s available here:

ProQuestionAsker/2016MovieDialogue
Contribute to 2016MovieDialogue development by creating an account on GitHub.github.com

Takeaways

Ok, so the analysis is done. I’ve got a fancy (and fun-to-play-with) visualization. What did I find?

I recommend taking a quick second to look at something “a-Dory-ble” before going on, because this post is about to get real depressing real fast.

1*MHd8U2CfQdn4uO32Kz7jbA

Aw, so cute. Feeling good?

All right, here we go.

This is a static version of what the visualization for all 10 movies looks like:

(If you’d like to check out the interactive visualization, go here.)

1*8KRKoDWaCXmD2Vc8CTR2Hg
The interactive version of this visualization can be found here.

There are a couple of things here that I need to point out:

Not one of the top 10 movies of 2016 had a 50% speaking, female cast.

Finding Dory was the closest to this level of equality with 43% female characters. To be equal, the movie would have needed 8 more speaking, female roles.

Rogue One was the worst. Only 9% of its speaking characters were female. Of those 10 characters, 1 was a computer voice, 1 appeared on screen for no more than 5 seconds, and 1 was a CGI cameo that said 1 word.

Only 1 of 2016’s top 10 movies had 50% dialogue by a female character.

Finding Dory comes out on top here too with 53% female dialogue. But, 76% of that dialogue came from Dory alone.

Trailing at the end was The Jungle Book with only 10% of its dialogue spoken by a female character. Keep in mind, this is after casting Scarlett Johansson as the voice of the historically-male snake, Kaa.

1*6ntt5aIdPDh-w-gpxh71AA
We’re gender equal….Trusssssssst in me….

Here’s a few more:

  • Finding Dory and Zootopia were the only 2 movies in 2016’s top 10 in which a female character had the most dialogue.
  • Female characters were outnumbered in Captain America: Civil War’s final battle 5:1. Throughout the movie, they only contributed 16% of the dialogue.
  • Batman spoke 2.4 times more than Superman and 6 times more than Wonder Woman in Batman V. Superman.
  • 78% of the female-spoken lines in Rogue One came from Jyn Erso.
  • While Harley Quinn was a highly advertised character in Suicide Squad, she only spoke 42% as many words as Floyd/Deadshot (played by Will Smith). Notably, Amanda Waller (played by Viola Davis) spoke frequently, totaling just 222 words (16%) short of Deadshot’s word count.

I started this project because I had a feeling that Rogue One’s cast and dialogue were not equally divided between male and female characters. I was shocked (and saddened) to find that almost none of the top 10 movies from last year were gender equal.

We can do better.

Added: If you’re looking for more studies and data explorations like this, check out:

TL;DR Version: Women represent (on average) 30–35% of speaking roles across each of these investigations.

Added: Have questions or comments about my methodology or conclusions? Check out my follow-up article featuring the most frequently asked questions.

I analyzed the dialogue in 2016’s biggest movies and it started a lot of conversations.
A few weeks ago I published a story about my analysis of the dialogue in 2016’s 10 Highest Grossing Films. I am so…medium.com

If you liked this article and want to see more like it, please click the green heart below and share away on your social media network of choice.

I am currently spending my time working on personal projects and data visualizations like this while I look for a data science job. So, if you have a fun project idea (or a job inquiry) you’d like to discuss with me, please reach out to me on Twitter or by email.

Thank you!