OCHA-DAP / hdx-ckan / #7169

81%

dev: 80%

Build Type

Pull #6867

coveralls-python

Committed by teodorescuserban

Commit Message

hdx-11355 add Redis cache for SES AssumeRole credentials via dogpile

  Replace in-memory singleton cache with shared Redis cache for AWS STS
  AssumeRole credentials. This solves the cache invalidation problem
  caused by nginx unit's idle_timeout (20s) killing worker processes
  and losing their in-memory credential cache.

  Changes:
  - Add caching.py with dogpile Redis region (55 min TTL)
  - Simplify credentials_manager.py to use cached_load_ses_credentials()
  - Remove ensure_fresh_credentials() - dogpile handles refresh automatically
  - Update mailer_patches.py and hdx_users_mailer_patches.py call sites
  - Rewrite tests to mock the new cached function

  Benefits:
  - All nginx unit processes share the same Redis cache
  - Credentials survive process restarts
  - Reduced AWS STS API calls (cost + latency)
  - Pattern consistent with ckanext-s3filestore 0.8.1

Pull Request Pull Request #6867: hdx-11355 add Redis cache for SES AssumeRole credentials via dogpile

Run Details

39 of 82 new or added lines in 2 files covered. (47.56%)

1 existing line in 1 file now uncovered.

14519 of 18135 relevant lines covered (80.06%)

0.8 hits per line