Doc
acaccb8cdd
- Replace log.Fatal() with proper error returns for better control flow
- Add type safety with dedicated structs instead of interface{} maps
- Implement proper HTTP client with timeout configuration
- Fix goroutine closure variable capture issues
- Add input validation for URL format and board extraction
- Ensure destination directory exists before writing files
- Improve error messages with context and proper error wrapping
- Add resource cleanup with defer statements for HTTP responses
- Separate concerns into dedicated functions for better organization
- Use filepath.Join for cross-platform path handling
- Add comprehensive logging throughout the application
This refactoring makes the downloader more robust, maintainable, and production-ready while preserving all original functionality.
scrapychan
Description
scrapychan is a go rewrite of a original scraperchan that i wrote in Python. There was no reason to rewrite the original program but atleast it is faster and i learned some go.
Install
Build from source
Dependencies
You just need to have go installed
Build
git clone https://git.protron.dev/Doc/scrapychan
cd scrapychan
go build
go install
Prebuild binaries
or use the binaries provided in the release section
How to use
scrapychan -u=<Thread URL> -o=<Destinationpath of media> -v=<true or false to enable verbose logging>