Skip to content

SPIKE - Explore what logs are available on AWS + Incubator #92

Closed
Closed
SPIKE - Explore what logs are available on AWS + Incubator#92
Assignees
ale210
Labels
complexity: mediumfeature: guide creationfeature: monitoringAutomated monitoringfeature: wikigood first issueGood for newcomersready for CoP Leadrole: DevOps Engineeraka Infrastructure Engineersize: 1ptCan be done in 4-6 hours
Milestone
06.02 Infrastructure - Org - Should have

Description

@JasonEb
JasonEb
opened on Oct 26, 2023

Overview

As an Ops member, I'd like to know what logs does Incubator currently have. Once a good understanding of what's available, we then can document it better on Incubator or Ops' wiki.

Action Items

  • Explore

    • ELB
    • RDS
    • ECR
    • ECS
    • Cloudwatch

  • Record and share results

Resources/Instructions

Activity

  1. JasonEb
    added
    feature: guide creation
    size: 1ptCan be done in 4-6 hours
    role: DevOps Engineeraka Infrastructure Engineer
    feature: monitoringAutomated monitoring
    ready for refinementleadership is asking for changes.
    on Oct 26, 2023
  2. JasonEb
    added this to the 06.02 Infrastructure - Org - Should have milestone on Oct 26, 2023
  3. JasonEb
    added
    good first issueGood for newcomers
    on Oct 26, 2023
  4. KazushiR
    self-assigned this
    on Nov 9, 2023
  5. ExperimentsInHonesty
    added
    feature: wiki
    on Jun 14, 2024
  6. ExperimentsInHonesty
    added this to CoP: DevOps: Project Boardon Jun 27, 2024
  7. github-project-automation
    moved this to New Issue Review in CoP: DevOps: Project Boardon Jun 27, 2024
  8. chelseyklein
    unassigned
    KazushiR
    on Jun 27, 2024
  9. chelseyklein
    removed
    ready for refinementleadership is asking for changes.
    on Jun 27, 2024
  10. chelseyklein
    moved this from New Issue Review to Prioritized Backlog in CoP: DevOps: Project Boardon Jun 27, 2024

  11. ale210 commented on Aug 28, 2024

    @ale210
    ale210
    on Aug 28, 2024
    Member

    Available logs:

    • ALB/ELB: When enabled, logs are published to s3 as gzip files for individual web requests. Within the gzip file, log entries appear as: https 2018-07-02T22:23:00.186641Z app/my-loadbalancer/50dc6c495c0c9188 192.168.131.39:2817 10.0.0.1:80 0.086 0.048 0.037 200 200 0 57 "GET https://www.example.com:443/ HTTP/1.1" "curl/7.46.0" ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 arn:aws:elasticloadbalancing:us-east-2:123456789012:targetgroup/my-targets/73e2d6bc24d8a067 "Root=1-58337281-1d84f3d73c47ec4e58577259" "www.example.com" "arn:aws:acm:us-east-2:123456789012:certificate/12345678-1234-1234-1234-123456789012" 1 2018-07-02T22:22:48.364000Z "authenticate,forward" "-" "-" "10.0.0.1:80" "200" "-" "-" TID_123456
    • RDS: Normal logs for either MySQL or PostreSQL are exposed via RDS. They contain errors, open/closed connections, queries, etc. RDS logs can also be sent to cloudwatch.
    • ECR: Logging is available via cloudtrail for new image upload, security scanning results, etc
    • ECS: Docker logging can be configured to go into cloudwatch. Additionally, it may be possible via cloudtrail to get ECS events like failed deployments, etc
  12. ale210
    self-assigned this
    on Aug 28, 2024
  13. ale210
    added
    ready for CoP Lead
    on Aug 29, 2024

  14. sudhara commented on Sep 12, 2024

    @sudhara
    sudhara
    on Sep 12, 2024
    Member

    per discussion with John (Food Oasis project), there are currently no logs for troubleshooting application issues - Heroku has ? logs that can be reviewed. DevOps team need to come up with a framework for various apps to do the application logging. ECS enable log could be an option to leverage in other projects.

  15. sudhara commented on Sep 19, 2024

    @sudhara
    sudhara
    on Sep 19, 2024
    Member

    closing this issue as the research work is complete.

  16. sudhara
    closed this as completedon Sep 19, 2024
  17. github-project-automation
    moved this from Questions/Review to Done in CoP: DevOps: Project Boardon Sep 19, 2024
  18. ExperimentsInHonesty
    added
    complexity: missing
    on May 19, 2025
  19. ale210
    added
    complexity: medium
    and removed
    complexity: missing
    on Aug 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

complexity: mediumfeature: guide creationfeature: monitoringAutomated monitoringfeature: wikigood first issueGood for newcomersready for CoP Leadrole: DevOps Engineeraka Infrastructure Engineersize: 1ptCan be done in 4-6 hours

Type

No type

Projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions