Git Repository Management

Overview

spark git provides multi-repository Git management capabilities: batch updates, repo initialization, submodule management, Gitcode remote configuration, and organization-wide cloning.

Core Capabilities

Multi-Repo Batch Update

Scans every Git repository under the configured directories and runs git fetch --all && git pull in bulk. Perfect for the day-to-day chore of maintaining many repos at once. When HTTPS is unreliable, add --ssh to force SSH for the run (the override applies only for the duration of the command; configured remote URLs are not modified).

spark git update -p ~/workspace
spark git update -p ~/workspace --ssh

Submodule Management

Add local GitHub repositories or remote URLs as submodules. Supports initialization, status display, URL rewriting, and batch sync.

# Add existing local repos as submodules
spark git submodule add ./path/to/repos

# Add a remote repo as a submodule
spark git submodule add https://github.com/user/repo
spark git submodule add https://github.com/user/repo --name custom-folder

# Initialize all un-cloned submodules
spark git submodule init
spark git submodule init -j 4             # 4-way parallel init
spark git submodule init --recursive      # Include nested submodules
spark git submodule init --name spark-cli # Only the named submodule

# Show submodule status
spark git submodule status

# HTTPS -> SSH URL conversion
spark git submodule ensure-ssh

# Sync every submodule to the latest
spark git sync ./my-mono
spark git sync --recursive

Highlights:

• init decouples initialization from remote update — it no longer force-merges. -j enables parallel clones.
• status renders a table with per-submodule init state, commit, and branch.
• ensure-ssh rewrites every HTTPS URL in .gitmodules to SSH with one command.
• git init recursively scans nested directories (e.g. projects/innate-ai-art) up to 3 levels deep.

Gitcode Remote Integration

Automatically adds a Gitcode (https://gitcode.com) remote to each repo, enabling GitHub ↔ Gitcode two-way sync.

spark git gitcode -p ~/workspace

Repository Initialization

One-shot init: git init → configure user → recursively scan subdirectories (3 levels) and add as submodules → generate .gitignore → initial commit → gh repo create --push.

spark git init --owner variableway              # Initialize and create the remote
spark git init --owner variableway --private    # Create a private repo
spark git init --skip-gh --owner variableway    # Local init only

Batch Cloning

Clone every repo for a GitHub organization or user, or refresh the repo status list in the README.

# Clone an organization's repos
spark git batch-clone variableway -o ./repos

# Clone a user's repos
spark git batch-clone jackwener -o ./repos

# Refresh org status
spark git update-org-status variableway --update-dot-github

Create Issues from Markdown

The unified spark git issues command creates GitHub issues from Markdown. Two input modes:

• Directory mode: every Markdown file under the directory becomes one issue.
• Task mode: a single task file is split by # Task <id> / ## Task <id> headings into multiple issues.

# Directory mode
spark git issues -d ./docs -r variableway/spark-cli

# Task mode
spark git issues -f tasks/issues/task-bug-fix.md -r variableway/spark-cli

# Auto-detect current repo + dry run
spark git issues -f tasks/issues/task-bug-fix.md --dry-run

Batch Push

Scans every GitHub repository, automatically committing and pushing any uncommitted changes.

spark git push-all -p ~/workspace

• Skips non-GitHub repos and repos with no changes
• Continues with the next repo on error

Git Repository Scanning

Recursively scans directories for Git repositories, enriches from the API (stars, forks, language, etc.), and persists results to a SQLite database.

spark git scan ~/workspace
spark git scan . --skip-api --db ~/.innate/feeds.db

• Default database path: ~/.innate/feeds.db
• Override via --db or the git.scanner.db config key
• Set GITHUB_TOKEN to raise the GitHub API rate limit

Parameters

Dependencies

• The git command-line tool
• The gh CLI (issues, batch-clone, update-org-status need GitHub API access)

Related

• Git Command Spec
• Git Usage Guide