Machine Learning and Data Science for ESG Compliance Measurement in Financial Software Engineering Projects: A Single-Case Socio-Technical Systems Analysis
Kenneth David Strang, Narasimha Rao VajjhalaThe integration of artificial intelligence (AI) and data science into organizational evaluation practices creates socio-technical systems in which human rating behavior, organizational templates, regulatory pressure, and analytical algorithms jointly determine what can be measured and learned. This single-case study examines the measurement of Environmental, Social, and Governance (ESG) compliance in financial software engineering projects, treating one firm’s project evaluation practice as a socio-technical system and applying an open-source data science and machine learning workflow to 207 anonymized archival project records. Correlation analysis revealed near-unity associations between the stakeholder-rated social and governance factors and the overall project score (r = +0.995 and +0.966, p < 0.001), while the environmental factor was unrelated to the score; post-hoc diagnostics (a seven-component principal-component structure, Harman’s screen, selective near-zero same-source correlations, and marker-variable partial correlations) bind, but cannot eliminate, method-based explanations, so the coefficients are interpreted as a descriptive property of the firm’s evaluation system rather than as estimates of relationships between validated, distinct constructs. Exploratory machine learning classifiers performed weakly—kNN at chance (AUC = 0.497) and SVM only modestly above the no-information baseline (accuracy 61.8%)—a result consistent with the constraints that the social subsystem imposes on the learnability of the records it generates, although technical factors, including the dichotomization of the target variable, the modest sample size, and model configuration, cannot be ruled out as contributing explanations; descriptive statistics are reported for all variables, and a diagnostic analysis reconciles the apparent divergence between the near-unity correlations and the weak classification performance by showing that the two rest on different feature sets, the near-redundant social and governance ratings having been withheld from the classifiers. The findings offer a proof of concept and a structured agenda for AI-enabled, project-level ESG measurement in socio-technical systems.