Principles for fair and accurate security ratings finallist 1

Vincent Voci Vincent Voci
Vice President, Cyber Policy and Operations, U.S. Chamber of Commerce


January 19, 2022


As security ratings continue to mature, more organizations in the public and private sectors leverage them in making business and risk decisions. As a key piece of a robust security evaluation program, security ratings based on accurate and relevant information are useful tools in evaluating cyber risk and facilitating collaborative, risk-based conversations between organizations. Security rating companies use a combination of data points collected or purchased from public and private sources and proprietary algorithms to articulate an organization’s security effectiveness into a quantifiable measure or score. As these ratings rely in part upon the quality and breadth of the data they use, the variety of sources and the dynamic nature of the environment create risks of producing ratings that can potentially be inaccurate, irrelevant or incomplete. To increase confidence in security ratings, an industry-wide, common approach should:

  • Promote quality and accuracy in the production of security ratings
  • Promote fairness in reporting
  • Include a coordinated process for adjudicating errors or inaccuracies in reported content
  • Establish guidelines for appropriate use and disclosure of the scores and ratings

We believe these principles will promote fairness in reporting and enhance the value of security ratings across all industries.

Transparency: Rating companies shall provide sufficient transparency into the methodologies and types of data used to determine their ratings, including information on data origination as requested and when feasible, for customers and rated organizations to understand how ratings are derived. Any rated organization shall be allowed access to their individual rating and the data that impacts a change in their rating.

Dispute, Correction and Appeal: Rated organizations shall have the right to challenge their rating and provide corrected or clarifying data. Rating companies should have an appeal and dispute resolution process. Disputed ratings should be notated as such until resolved.

Accuracy and Validation: Ratings should be empirical, data-driven, or notated as expert opinion. Rating companies should provide validation of their rating methodologies and historical performance of their models. Ratings shall promptly reflect the inclusion of corrected information upon validation.

Model Governance: Prior to making changes to their methodologies and/or data sets, rating companies shall provide reasonable notice to their customers and clearly communicate how announced changes may impact existing ratings.

Independence: Commercial agreements, or the lack thereof, with rating companies shall not have direct impact on an organization’s rating; any rated organization will be able to see and challenge their rating irrespective of whether they are a customer of the rating company.

Confidentiality: Information disclosed by a rated organization during the course of a challenged rating or dispute shall be appropriately protected. Rating companies should not publicize an individual organization’s rating. Rating companies shall not provide third parties with sensitive or confidential information on rated organizations that could lead directly to system compromise.

The following organizations are supportive of the principles for fair and accurate security ratings.

Support for these principles should not be construed as an endorsement of a particular company or methodology.

  1. AbbVie
  2. AES Corp.
  3. Aetna
  4. American Express
  5. Bank of America
  6. Bank of New York Mellon
  7. BitSight
  8. Blackstone
  9. BT
  10. Charles Schwab
  11. Chevron
  12. Cisco
  13. Citigroup
  14. ClearForce
  15. ClearSky
  16. CyberGRX
  17. Dealogic
  18. Eli Lilly and Company
  19. E*TRADE
  20. Fannie Mae
  21. FICO
  22. Goldman Sachs
  23. The Home Depot
  24. Honeywell International
  25. JPMorgan Chase & Co.
  26. Lockheed Martin
  27. Microsoft
  28. Morgan Stanley
  29. NRG Energy, Inc.
  30. NTT
  31. Rackspace
  32. Raymond James Financial
  33. Raytheon
  34. RiskRecon
  35. Schlumberger
  36. Securities Industry and Financial Markets Association (SIFMA)
  37. Security 50
  38. Security Scorecard
  39. Starbucks
  40. State Street
  41. TIAA
  42. U.S. Bank
  43. Verizon
  44. Wells Fargo

Principles for fair and accurate security ratings finallist 1

About the authors

Vincent Voci

Vincent Voci

Vice President for Cyber Policy and Operations in the Cyber, Intelligence, and Supply Chain Security Division at the U.S. Chamber of Commerce

Read more