Skip to content

Use GH Archive to pull 2024 stats - #38

Draft
edmundmiller wants to merge 10 commits into
mainfrom
gharchive
Draft

Use GH Archive to pull 2024 stats#38
edmundmiller wants to merge 10 commits into
mainfrom
gharchive

Conversation

@edmundmiller

Copy link
Copy Markdown
Contributor

No description provided.

@netlify

netlify Bot commented Feb 3, 2025

Copy link
Copy Markdown

Deploy Preview for nf-core-stats ready!

Name Link
🔨 Latest commit f8c4885
🔍 Latest deploy log https://app.netlify.com/projects/nf-core-stats/deploys/693a8da85be613000877a07d
😎 Deploy Preview https://deploy-preview-38--nf-core-stats.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

Comment thread pipeline/pyproject.toml
@@ -9,7 +9,9 @@ dependencies = [
"dlt[cli,duckdb,motherduck]>=1.4.1",
"python-dotenv==1.0.0",
"requests>=2.31.0",

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this version seems to not be available?

Comment thread pipeline/pyproject.toml Outdated
Comment on lines +12 to +13
"slack-sdk>=3.33.0",
"pendulum>=2.1.2",

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same for these ones

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am trying to resolve the environment with poetry and it has been running for an hour now 😢 ...

Comment thread pipeline/gharchive_pipeline.py Outdated
current_hour = current.replace(hour=hour)
if current_hour > pendulum.now():
break
yield from _process_gharchive_hour(current_hour)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When trying to run this I got this error

dlt.pipeline.exceptions.PipelineStepFailed: Pipeline execution failed at stage extract when processing package 1738663913.5012522 with exception:

<class 'dlt.extract.exceptions.ResourceExtractionError'>
In processing pipe raw_events: extraction of resource raw_events in generator events caused an exception: name '_process_gharchive_hour' is not defined

@claude

claude Bot commented Dec 11, 2025

Copy link
Copy Markdown
Contributor

Claude encountered an error —— View job


I'll analyze this and get back to you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants