Yevhen Odynets
ebb86d094a
Handle the page::1m marker before the generic single-uri branch
(previously unreachable):
- select the latest prescene source from external_sources with meta IS NULL
(sql.ErrNoRows -> no-op)
- parse article.single: type_id from post-(\d+), size_mb, genre,
unique artists, tracks count and total duration (h:M:s)
- download the release NFO (anchor "Download NFO" -> onclick href)
and save it to <nfo_dir>/<first-letter-of-title>/<title>.nfo
- update external_sources.meta with compact JSON by id via db.Exec,
writing {} when every field is empty
Add model.ScnlogMeta / model.ScnlogSource structures.
80 lines
1.2 KiB
YAML
80 lines
1.2 KiB
YAML
role: console
|
|
endpoint: https://scnlog.me/music/flac/
|
|
endpoint-next: page/%s/
|
|
sleep-before-next-iteration: 5s
|
|
levels-to-scrape: 6
|
|
nfo_dir: k:\data\mdb\nfo
|
|
groups:
|
|
tags:
|
|
neformat:
|
|
- SHGZ
|
|
remove:
|
|
- BIGLOVE
|
|
- CT
|
|
- ENViED
|
|
- GARLICKNOTS
|
|
- Ouzo
|
|
- PTCx
|
|
- SHGZ
|
|
- XiVERO
|
|
ignore:
|
|
- "401"
|
|
- 6DM
|
|
- AFO
|
|
- AOVF
|
|
- AOVF_Classics
|
|
- AUDiOFiLE
|
|
- BABAS
|
|
- BBD
|
|
- BEATOCUL
|
|
- CALiFLAC
|
|
- CEBAD
|
|
- D2H
|
|
- DALiAS
|
|
- dh
|
|
- DWM
|
|
- EMP
|
|
- ENRiCH
|
|
- ERP
|
|
- ESGFLAC
|
|
- FATHEAD
|
|
- FiXIE
|
|
- FLACME
|
|
- FrB
|
|
- HOUND
|
|
- JRO
|
|
- KINDA
|
|
- MAHOU
|
|
- MARiBOR
|
|
- MEOWZiK
|
|
- MFDOS
|
|
- MLS
|
|
- Mrflac
|
|
- MUNDANE
|
|
- MyDad
|
|
- NRS
|
|
# - OBZEN
|
|
- OTT
|
|
- PERFECT
|
|
- PLAYLiST
|
|
- PTC
|
|
- PWT
|
|
- RAGEFLAC
|
|
- RAWBEATS
|
|
- RECTiFY
|
|
- ROSiN
|
|
- STAX
|
|
- THEVOiD
|
|
# - TiMES
|
|
- TM
|
|
- TVRf
|
|
# - VEXED
|
|
- WAVED
|
|
- YARD
|
|
- HiTE
|
|
- RPO
|
|
- MEOWZiK
|
|
- STONERD
|
|
- TR
|
|
- W4GN3R
|