Cloudinary CDN Synchronization
How media is mirrored to Cloudinary to prevent expired Instagram image links.
Cloudinary CDN Synchronization
Instagram CDN URLs contain short-lived cryptographic tokens (&_nc_ht=...&oh=...). Within days or weeks, these URLs return HTTP 403 Forbidden.
How Media Sync Works
- Background Job Queue: As posts are discovered, their media URLs are queued for mirroring.
- High-Res Ingestion: The system downloads the highest resolution candidate and streams it to Cloudinary.
- Carousel Processing: For multi-image/video posts, every item in
carouselMediais mirrored with its original display order. - URL Replacement: The local database updates
cloudinaryThumbnailUrlandcloudinaryUrl, serving ultra-fast, permanently available images.
Profile Picture Change Detection
The archiver computes a cryptographic SHA-256 hash of creator profile pictures:
- When a creator updates their profile picture, the tracker detects the hash discrepancy.
- The new avatar is synced, and an append-only
profile_pic_changedevent is logged to the creator's timeline.