How S&P is using deep web scraping, ensemble learning and Snowflake architecture to collect 5X more data on SMEs

venturebeat.comPublished: 6/2/2025

Summary

The article highlights S&P Global's innovative solution, RiskGauge, which uses AI-powered data scraping and machine learning to assess SME creditworthiness by extracting insights from millions of web pages. By leveraging Snowflake architecture, the platform efficiently processes vast datasets, enabling faster and more accurate credit scoring for over 10 million private U.S. SMEs. This advancement empowers investors with detailed risk reports, enhancing their ability to evaluate and manage financial decisions involving thousands of companies daily.