Skip to content
OpenTrain AIFor AI Companies

Automated Implementation of Windows-related Security-Configuration Guides

Patrick Stöckle, Bernd Grobauer, Alexander PretschnerPublished Sep 19, 2022
arXiv PDF DOI
Researcher verdict
Starting point
Use as implementation starting point
Benchmark evidence
Missing
Not verified yet
Time to first repro
A few days
Plan setup time
Risk flags
1
Review before use

Abstract

Domain fit: AI-adjacent · Paper appears method- or tooling-adjacent to AI workflows with partial ecosystem coverage.

Hardening is the process of configuring IT systems to ensure the security of the systems' components and data they process or store. The complexity of contemporary IT infrastructures, however, renders manual security hardening and maintenance a daunting task. In many organizations, security-configuration guides expressed in the SCAP (Security Content Automation Protocol) are used as a basis for hardening, but these guides by themselves provide no means for automatically implementing the required configurations. In this paper, we propose an approach to automatically extract the relevant information from publicly available security-configuration guides for Windows operating systems using natural language processing. In a second step, the extracted information is verified using the information of available settings stored in the Windows Administrative Template files, in which the majority of Windows configuration settings is defined. We show that our implementation of this approach can extract and implement 83% of the rules without any manual effort and 96% with minimal manual effort. Furthermore, we conduct a study with 12 state-of-the-art guides consisting of 2014 rules with automatic checks and show that our tooling can implement at least 97% of them correctly. We have thus significantly reduced the effort of securing systems based on existing security-configuration guides.

Results and benchmarks

Freshness tier: cold
Hardening is the process of configuring IT systems to ensure the security of the systems' components and data they process or store.

Implementation

Historical official implementation (not recommended for new builds)

Why this implementation
Confidence: low

Only historical official repository was found (tum-i22/cis-benchmark-evaluation).

Open tum-i22/cis-benchmark-evaluation
Reproduction risks
  • Only historical official implementation is available
  • No direct maintained implementation is currently verified.
  • Only historical official repository was found: tum-i22/cis-benchmark-evaluation.
  • No maintained paper-verified implementation met reliability thresholds.

Compare implementation paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

Maintenance
Stale
Confidence
High
Reproducibility
Limited
Stars
3
Last push
Mar 16, 2022 (1623d)

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata

  • No push in 12+ months
  • No CI pipeline detected
  • No tagged releases
Maintenance
Stale
Confidence
High
Reproducibility
Limited
Stars
2
Last push
Sep 5, 2022 (1450d)

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata

  • No push in 12+ months
  • No CI pipeline detected
  • No tagged releases
Maintenance
Stale
Confidence
High
Reproducibility
Limited
Stars
1
Last push
Sep 5, 2022 (1450d)

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata

  • No push in 12+ months
  • No CI pipeline detected
  • No tagged releases

Reproduction readiness

Time to first repro: days
Last checked: Aug 24, 2026

Major work

No dependency manifest, manual reconstruction required

  • tum-i22/cis-benchmark-evaluation has no requirements.txt, environment.yml, pyproject.toml, or Dockerfile.
  • You will need to reverse-engineer dependencies from import statements in the source code.
  • Last push was 1623 days ago.
Open tum-i22/cis-benchmark-evaluation

Hardware requirements

  • Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Repositories and ecosystem

Official

  • This repository is part of the paper Automated Implementation of Windows-related Security-Configuration Guides presented at the 35th IEEE/ACM International Conference on Automated Software Engineering.

    2 stars · 1 forks · Last push Sep 5, 2022 · GPL-3.0 license

  • This repository is part of the paper Automated Implementation of Windows-related Security-Configuration Guides presented at the 35th IEEE/ACM International Conference on Automated Software Engineering.

    1 stars · 0 forks · Last push Sep 5, 2022 · GPL-3.0 license

Community

No additional community repositories detected yet.

Hugging Face artifacts

No trustworthy direct or curated related Hugging Face artifacts were found yet. Use targeted searches to quickly locate candidate models, datasets, and demos.

Tip: start with models, then check datasets and spaces if you need evaluation data or demos.

Research context

7

Citations

34

References

Tasks

Computer science, Automation, Process (computing), Task (project management), Software engineering, Database, Operating system

Methods

None detected

Domains

Computer security

Evaluation and human feedback data

Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.

Open in HFEPX
Explore similar papers

Data includes links from Papers with Code ( CC-BY-SA-4.0 ).