Facebook

The Current State of SMTP STARTTLS Deployment

Protect the Graph

A lot of sensitive data is sent over email, so we encrypt emails in transit via STARTTLS when available. STARTTLS has been around for 15 years, but we'd heard that it wasn't widely deployed. To test that perception, we decided to see how many of the notification emails we send are successfully encrypted.

We found that 76% of unique MX hostnames that receive our emails support STARTTLS. As a result, 58% of notification emails are successfully encrypted. Additionally, certificate validation passes for about half of the encrypted email, and the other half is opportunistically encrypted. 74% of hosts that support STARTTLS also provide Perfect Forward Secrecy.

It's clear to us that STARTTLS has achieved critical mass and there is immediate value in deploying it. We encourage anyone who has not already deployed STARTTLS to at least deploy it for opportunistic encryption. As more systems support email encryption, the value increases for everyone.

Methodology

Facebook sends several billion emails to several million domains every day. This is mostly comprised of notification emails about various activities on Facebook as well as account-related emails such as registration confirmations and password resets. We used a single day's worth of our notification email logs from our production system for this report, since our goal here is to show a snapshot of current deployments rather than configuration changes over time. These logs contain the kind of data you would expect to find in any email server logs, such as the sender and recipient, where the email came from, and where we are sending it. For the purposes of this report we only concern ourselves with the STARTTLS results, the recipient's domain, the MX hostname we connected to, and the receiving email server's IP address.

The majority of email addresses we send to are assumed to be for personal use. Given the large number of addresses and domains we send to, we feel that our data provides a good representative sample of personal and general purpose mailbox providers. Government and corporate email systems are likely underrepresented in this report.

Our system attempts to negotiate TLS encryption with every SMTP server it connects to which advertises the STARTTLS capability. If the negotiation is successful, we encrypt the email and send it on. If we can't successfully negotiate, then we send the email unencrypted. We log the results in either case, including the negotiated cipher suite and attributes of the certificate presented by the server when we are successful. We then load the logs into Hadoop for further analysis. It's also worth noting that the performance impact of enabling TLS for outbound connections was negligible.

Data and Observations

The following graphs show the log data aggregated in various ways. For graphs that show STARTTLS results, we show the relative percentages of 'Strict', 'Opportunistic', 'Failure', and 'None'. These categories are defined as follows:

Strict: A TLS cipher suite was successfully negotiated and the presented certificate passed strict validation. Strict validation means that the certificate was not expired, was signed by a trusted certificate authority, and matched the hostname we connected to. We allow wildcarded certificates.

Opportunistic: A TLS cipher suite was successfully negotiated but the presented certificate did not pass strict validation for one or more reasons.

Failure: The SMTP server advertised STARTTLS, but we could not successfully negotiate a cipher suite. This could be due to a lack of acceptable cipher suites or other configuration issues. As a result, the email was sent unencrypted.

None: The SMTP server did not advertise STARTTLS. The email was sent unencrypted.

Figure 1 - Overall STARTTLS Results

Figure 1 shows the overall results of STARTTLS behavior. From the 'All Email' bar on the left we can see that nearly 60% of all emails are sent via an encrypted connection, but only about 30% pass strict validation. 60% is an encouragingly high percentage, but this number is potentially skewed since the bulk of email volume is sent to a small number of large mailbox providers. We need to aggregate the data in a few different ways in order to compensate for this and get a clearer picture of STARTTLS behavior across all email systems. The other three bars in Figure 1 are based on unique counts of the following identifiers:

Domain: The domain portion of the recipient email address.

MX Hostname: The hostname returned by querying the MX record of the domain.

IP Address: The IP address of the receiving SMTP server.

The relationships between these three identifiers vary as inbound email infrastructure is deployed and configured as needed, and operators use different techniques to manage their infrastructure at different scales. For example, 25.76% of unique recipient address domains pass strict validation, while 7.97% of unique MX hostnames pass strict validation and only 6.63% of unique server IP addresses pass strict validation. This is because a single MX hostname can handle traffic for many domains and can have multiple unique IP addresses behind it, a single domain can have multiple MX hostnames, etc.

The 'Domain', 'MX Hostname', and 'IP Address' bars show a higher percentage of encrypted traffic but a lower percentage of strict validations than the 'All Email' bar. These results show that STARTTLS support is widely deployed, but that there are also widespread issues with certificates. Also of note, in all cases the number of failures is very small.

Figure 2 - Overall reasons for strict validation failure

Figure 2 shows the top reasons why strict validation fails as a percentage of opportunistically encrypted traffic. Some reasons or combinations of reasons are not listed, such as 'Expired and Mismatched'. Those have been omitted because they account for less then 1% for each identifier. The failure reasons are as follows:

Self Signed: The presented certificate was signed by the domain itself instead of a certificate authority.

Untrusted CA: The presented certificate was signed by a certificate authority that we consider untrustworthy.

Mismatched: The presented certificate does not match the hostname exactly or via wildcard.

Expired: The presented certificate has passed its expiration date.

Mismatched certificates are the single largest reason why strict certificate validation fails across all identifiers. 99.35% of all opportunistically encrypted emails fail validation simply because the certificate does not match the hostname; the certificates are otherwise acceptable. The next three largest categories include mismatched certificates as part of the reason, but have additional issues.

Figure 3 - Successfully negotiated cipher suites

The strength of supported cipher suites is a common concern, as weak or vulnerable ciphers can be easily defeated. Figure 3 shows the successfully negotiated cipher suites broken down by identifier. The majority of encrypted email is sent with the ECDHE-RSA-RC4-SHA or DHE-RSA-AES256-SHA cipher suite. This is likely due to those being the preferred cipher suites of the major providers. DHE-RSA-AES128-SHA, however, is the preferred cipher suite for the largest percentage of deployments. AES128-SHA is the next most prevalent, which is concerning because it does not provide Perfect Forward Secrecy.

Figure 4 - Perfect Forward Secrecy support in negotiated cipher suites

Although the second most prevalent cipher suite does not provide Perfect Forward Secrecy, the majority of preferred cipher suites do—as shown in Figure 4.

Conclusion

STARTTLS encryption is widely supported and has achieved critical mass despite some issues with certificate management. A system deploying STARTTLS support for the first time can expect more than half of its outbound email to be encrypted. Also, the majority of deployments provide Perfect Forward Secrecy. We see two high priority areas for improvement. First, we encourage the industry to work together to develop better tools for preventing mismatched certificates. Second, we encourage everyone to deploy support for opportunistic encryption via STARTTLS.

Michael Adkins is a Mail Integrity Engineer at Facebook.

Appendix 1: Open Source MTAs

Figure 5 - STARTTLS results for open source MTAs

These results are for hosts that identify as either Sendmail, Postfix, Exim, or Qmail in their SMTP banner and are counts of unique MX hostnames. The majority support opportunistic TLS, but the number that pass strict certificate validation is very small.

Figure 6 - Strict validation failure reasons for open source MTAs

Again, mismatched certificates is the most common reason for strict validation failure, but Postfix and Qmail have larger percentages of hosts with multiple failure reasons.

Appendix 2: Major TLDs

Figure 7 - STARTTLS results by major TLD

TLD results are based on the domain portion of the recipient address and are counts of unique MX hostnames. The results are fairly consistent, with .edu representing a larger percentage of hosts that pass strict certificate validation but a lower overall percentage of hosts that successfully encrypt traffic.

Figure 8 - Strict validation failure reasons for major TLDs

Mismatched certificates are again the most common reason for strict validation failure.

Appendix 3: European Country Codes

Figure 9 - STARTTLS results for European country codes

European country code results are based on the domain portion of the recipient address and are counts of unique MX hostnames. Figure 9 displays the top 10 European country code TLDs by raw email volume in no particular order. Support for opportunistic encryption is fairly high across the region.

Figure 10 - Strict validation failure reasons for European country codes

Strict validation failure reasons are more varied. Mismatched certificates still figure prominently as a failure reason, but several countries have higher percentages of hosts with multiple issues.

Appendix 4: Asian and Pacific Country Codes

Figure 11 - STARTTLS results for Asian and Pacific country codes

Asian and Pacific country code results are based on the domain portion of the recipient address and are counts of unique MX hostnames. Figure 9 displays the top 10 European country code TLDs by raw email volume in no particular order. Support for opportunistic encryption is lower across the region than in Europe.

Figure 12 - Strict validation failure reasons for Asian and Pacific country codes

Strict validation failure reasons are a little less varied than in Europe. Mismatched certificates is the most common failure reason in five of the countries, while mismatched and self signed certificates is the most common failure reason in the other five.

Mohammed Umar Farooq

Bangladesh POINT number +8801889858200

David Evans

Thanks for your comment TiffanyFisher ☺

Bublik Moskow

Mikey Gawhega

David Evans

Hi everyone have a wonderful day/night 🌙

Dana Warren

Protect my services

Dana Warren

Unsustbed sites I want them blokd

Dana Warren

No third party sharing

Dana Warren

Block unidentified sites

Sandra Engelsberger

Hey

David Evans

Hi Sandra Engelsberger: I looked at your picture and you are very beautiful ❤

David Evans

Be sure to protect the graph

Surasuk Phubunplook

David Evans

Hello Surasuk Phubumplook -- Have a Wonderful day/night --

Jawaban Reski

Oke terima kasih mendapat ilmu yang melimpah

Sharon J. Campbell

I also like Wish products. Have proven to be worth my while and $$ really great bargains I am pleased with Wish/Mama.com I would recommend them to anyone! ❣️🇺🇸👵🏻😻🐈

علي وعبدالله العسيري

0563181094

Cheryl Latham

Crecí Marina

Que hacer para que mi correo tenga TLS??

Narendra Dungarshi Soni

Nice

Hariom Shelar

David Evans

Awesome

Diana Zainudin

เป็นฅน กลาง เลยไม่มี

How long can you come home

David Evans

I am home and have been staying home and If go to a Doctor's appointment I can come home. The virus is still spreading here

David Evans

Everyone here have a wonderful night/day -- depending on your time zone 😀

Shah Shahid

احمذ محمد

David Evans

Hello to everyone

Adnan Dmlhy

Thao Nguyen

tôi đồng ý

David Evans

You look like a nice person Thao Nguyen --It is ice to see you Here❤️

Veronica Atilano

Gracias por todo lo que hacen para mi

David Evans

You are very welcome Veronica Atilano ❤❤

Jammie Cook

Anup Mallick

3760196

Anup Mallick

(3760196)

David Evans

Jammie Cook, hi how are you today? Let's talk ❤❤

Pháp Alexis

Ruth Dadnirit

David Evans

Greetings Ruth Dadnirit Hope you are having a good day. Nice to meet you ❤️❤️

Jay-v Abarra

Hello to all.phillipines are her✌

Jon Viray

🤔

មនុស្ស អស់កែ

TLS

David Evans

I lived in the Philippines for a year and 1/2 -- The Philippines are beautiful

Abdul Razzaque Shar

David Evans

Hi RazzakBhai hope you have a wonderful day

David Evans

Donate to protect the children

Gorav Sony Sony

My help

David Evans

Hello Touhidol Islam -- I like Halloween too -- keep safe

Javed Haneef

Hy please help me now one time every one more time please

David Evans

Hello Jared Haneef -- Do you need some help from me on something? --

Tipon Miah

Nics

David Evans

Hi to you Tipon Michael how things going in India. Hope your weekend is good

ดอน สระบัว

ชอบมากเลยครับ

ดอน สระบัว

ชอบมากเลยครับ

Abdul Wadood Khan

i love you all my friends

David Evans

I like it too it is very nice👌. How are you doing in India very glad I hope 😀

Junaid Khan

My help

David Evans

Junaid Khan -- your help would be greatly appreciated for anyone who needs help. I like Supercross also.

Nghĩa Tình Đất Mũi

Úp

David Evans

Phak Kay -- I think you are very beautiful and sexy. I also like the motorcycle 🏍 you have in the background of your profile picture. How are things in Tan Uyan?❤

Watot Cartoon

What is this?

David Evans

Walt Cartoon -- It can be anything you want it to be my friend

Da'i Arif

Śťýĺiśh Bøý Bhawani

Sanam Hasanava

Merhaba

Isabel Almeida

Aí Ai Ai

David Evans

Isabel Almeida You sound surprised
❤❤

Visissak Kongsoodta

วิศิษฏ์ศักดิ์ กองสูดตา

David Evans

Visissiak Kongsoodta -- Hello I hope you have a wonderful weekend 😊 --

Day Mi Yan

Love bro

David Evans

YA Wai Aung -- Right Back AT You Bro --

Sameer Khan

Hui

José Antonio Rodriguez Verduzco

Merna Reynold

Yeah very lovely

Adriana Albuquerque

Não consigo falar

David Evans

Adriana Albuquerque Will you get into trouble? Your neice lives in Albuquerque. ❤

Sandy Breen

Okay I gave you my info in good faith. I thing your a very good lookingwoman.And i thinkwe can have a lot of fun together.O like to go out and have as good time when I'm off for the week end. Give me a call when you get time.

Cangtruong Ly

Chào các bạn có thể gặp tình cờ là có duyên

Cangtruong Ly

David Evans

Cangtruong Ly --Helloq you have a good night's sleep tonight --

Janese Johnson

Hello

David Evans

Janese Johnson -- I hope you are having a good day there in Las Vegas today. Have you won much money when you play the games. You are a very beautiful and sexy woman ❤️

David Evans

Protect The Graph 📊

Jesus Humberto Zelaya

Yew Itsara

David Evans

Yew Itsara l am sure you had a nice time visiting Italy 🇮🇹

Pavel India

Mojej

Pavel India

Lek Narak

Souksavanh Thepphavong

Ngo Thi My

Foysal Ahmed

MD Irwadi Ahmad

Hi avrey one tq

سير الشوف

Gswh26@gmail.com

Asif Selimov

Asif.selimov.88@mail.ru

Asif Selimov

https://rest.goldenpay.az/web/pay/a03d2d6e-1e86-4969-9d96-373e68b3c129

Khadim Hussain Shahani

khadimhussainshahani4

M Riand

Vith Vith

vithv862@gmail.com

Adi Permana Jr.

Hendra Andesta

https://support.zendesk.com/hc/requests/6324109

Salemaal Qeer

Selayahay xaalada ka warama bal

Mohammed Aldhaheri

بعض الاختصارات للعميل حرية الاختيار اذا كانت مشفره ام لا في وجهت نظري لايملك الخصوصه التي نتوقعها من موفر الخدمه او الطاف الثالث من البرنامج

Izat Afridi

Tien Tran

Xl mỗi nguoi

Charles Johnson

TVEC POWER OUTAGE SINCE 4:00 AM THAT'S UNCALLED FOR🤠

Muhammad Izatt

Help

Ălêýą Åļò

Guy White

MD Irwadi Ahmad

Dina Chalka

Δεν μου αρέσει όντως είναι δική μου. Και η φωτογραφίαλήθεια δικη μοθ

Dina Chalka

Μου αρέσει η φωτογραφια

Dina Chalka

Μπορεί να γίνει ανάρτηση

Dina Chalka

Τι

Fernando Federico Aguado Amoros

Todavía estoy esperando que me conteste el teléfono A. Ver si me lo soluciono

Danny Rogers

To all the rest of u boy boy boy like I dony know...like I care! Nothing but fools

Hb Nasiruddin Miah

nasiruddin
88001994343295

MD Saiful Islam

Gmail

লন্কা পতি রাবন

Topan Akbar Anjarmara

apa ni

RQ Ileina

My hatphone give me

Mustafa Kabir

User:Platonides/SSHKey

Gustavo Angel

Ali Messaoudi

Voir en langue française

Anthony D. Johnson

Angga Putra

Nice

Leonard Tafoya

Siiornara

Anna Anna

Coucou

เอิร์ธ ออ

Vijay Raj

Kowit Rueangsi

Myo Thu

Good

เจนศักดิ์ สีสมุทร์

Abo Hasan

Mustafa Kabir

UNICEF Reference Id:7d26cd50 Executive Bord-Year In-2020.2021 Parliament Mission of The People Republic of Bangladesh To The United Nations.Sencierly From.UN Virtual Presidan.@[100045137359047:2048:Mustafa Kabir]..web:https://www.facebook.com/mustafa kabir.5815

Sherwan Mhamad

Bernard Williams

What

حمدي ابو عبدربه الزهر

734216528حمدي سعيد

نظرًا لأنه لم يتم العثور على العنوان، أو لا يمكن لذلك العنوان استلام الرسائل الإلكترونية

Lac Nguyen

Cezat Andal

เจ้สีมณี พาเพลิน

OKค่ะ

นรธีร์ อัตขันธ์

okคคับ

Foreth Petir

Hi👋

Bill Hoffman

Hi!

Bobby Littleton

Ifi

Trish Armelin

What does all this mean?

Mohammad Mohammad

Blak Amichet

Hola

Blak Amichet

Carlosromandelangelramos@gmail.com

Blak Amichet

Putos pendejos

Blak Amichet

Chinguen a su madre

ไอดี อาแด

ช่วยปรับปรุงที่

Jody Frencheater

hello

Bholu Ingh

Hii

Akes Kimmy

Some one is signed in my account and tls is not on what do I do

Ravindra Gaykwad

เบบี้' เฟิร์ส.

เข้าแอปธนาคารไมได้

Joop Jaeng Chanada

FanFacebook page stream life watch contacts to Chanel YouTube help me please.

نگاه مهربان

🙋‍♀️🙏🏻⚘

Tamim Sh

مرحبا

Whilmor Carroll

YouTube

Sandeep Kushwaha

Hiii every one

Sandeep Kushwaha

YouTube

Иван Туманов

Приветствую вас

Diana Miller

Thanks for your support an having my Back. Love you PCH.

Norhanah Matthew

Sye nk ekaun lama sye

Firdin Farhad

Anton Vexler

069282

Anton Vexler

069282

Anton Vexler

Лена очень Рио девушка 👩👩👩она меня бесит когда она говорит мне о том что она меня любит когда ты говоришь что ты любишь меня как мне быть с тобою рядом и говорит о ней только потому что она хочет меня убить любит меня так что я не могу его ненавидеть до конца своей жизни любит и не будет любить меня другой душой быть рядом с любимым любит и любимый человек поймёт что ты любишь меня так далее мл ку и говорит о том как она хочет быть с вами и не хочет быть рядом со мной в этом доме или как я 7211 1387 1 с тобой в постель с тобой в постели с другой ты думаешь что я хочу быть рядом с другой девушкой другой парень или на другой Рио девушка 👩👩👩она меня бесит и говорит о ней только потому что она хочет меня убить любит меня так что я не могу его ненавидеть до конца своей жизни любит и не будет любить меня другой душой быть рядом с любимым любит и любимый человек поймёт что ты любишь меня так далее м

سعد الغامدي

,😍🤩🌹احبكم جميعاً

Merlyn Kim

I don't know who's this person
Good people won't do like this nasty thing...I claim God is with us

นัฐพงษ์ สิบรัมย์

Alexandre Dos Santos

Que bom que eu tive 21 pessoas que visualizaram algo no meu perfil isso é muito legal porque a tecnologia ela une as pessoas em vários locais do país e do mundo as pessoas do bem sempre procura o melhor o conhecimento é valioso obrigado a todos Obrigado vida