Look until Trusted

CAS-3 Order: #3 Exploratory Data Analysis Has Dependencies

Updated 1 month, 2 weeks ago

Purpose

See the delivery cycle as people live it until the impact ranking can be trusted. This is not a query-console step.

streamlit/data/cost_of_delay.yaml, ai_opportunities.yaml, role_capacity.yaml.
Mart URL: docs/deploy-manifest.yaml → streamlit_mart_url.
Notebook notebooks/look-until-trusted.ipynb.
Skills EDA with Streamlit Data Mart, EDA with Pandas and Jupyter, MCP-Driven Conversational Analytics, Metric Render Catalog → Render pairings / Starter mart tabs.

Open the mart URL. Home is Delivery cycle, then Opportunity quadrant. Feature Cycle Time (pages/11_Feature_Cycle_Time.py) is a check, not the ranking.
Look at the whole flow first. Use Metric Render Catalog pairings to challenge the #1 constraint (lead/cycle, throughput, MR hours, CI failure, load). Skip any family whose contract views are missing.
Challenge assumed numbers in role_capacity.yaml; relabel or remeasure. Jira status_segments: touch/wait may be measured (business days). Do not mix with PR hours.
Chat/MCP findings are hypotheses until reproduced in notebooks/look-until-trusted.ipynb (Restart & Run All).
Copy survivors into streamlit/data/promoted_eda.yaml (metric id, pairing, unit, n, window, agrees_with_ranking, query_execution_id, tsy_section). Empty file (rows: []) is valid if nothing earned TSY — that is not a Present Findings bug.

If LoginRefreshRequired / CreateOAuth2Token expired → aws login, restart kernel, not a Glue/Athena ACL bug. Skill Athena SQL Querying / EDA with Pandas and Jupyter.

Impact ranking survives a second look (or was corrected in YAML).
Any finding that will inform triage has query text + QueryExecutionId.
Catalog checks that disagree with the ranking are explained or the ranking is updated.

Triage: Eliminate / Automate / Delegate.

Reconstruct the delivery cycle, score impact, look until the ranking can be trusted, then decide what to drop or automate. …

Agent: Operations Analyst Role Turns the catalog into an understanding of where the delivery cycle …

EDA with Pandas and Jupyter Data Science Python, Pandas, Jupyter, Plotly
EDA with Streamlit Data Mart Business Analytics Streamlit, ECS Fargate, ALB, Athena
MCP-Driven Conversational Analytics AI Tooling Model Context Protocol, Claude Desktop
Metric Render Catalog Analytics Communication Athena, Streamlit, Jupyter

AI Opportunity Prioritization Matrix Document Required
Produced by: Score Cycle Impact
Athena Catalog Views Document Required
Produced by: Present the Catalog via Athena
CDK Application (Infrastructure Stacks) Document
Produced by: Model the Data Lake as CDK Stacks
Cost of Delay Ranking Document Required
Produced by: Score Cycle Impact
Delivery Cycle Reconstruction Document Required
Produced by: Score Cycle Impact
Populate-Lake Pipeline Document Required
Produced by: Backfill Historical GitHub Events
Role Capacity Assumptions Document Required
Produced by: Score Cycle Impact
Streamlit Data Mart Document
Produced by: Model the Data Lake as CDK Stacks