# 🔍 Crawling & Indexing Settings Guide

Depending on what you're setting up, here are the best configurations:

---

## 1️⃣ RSS Feed Refresh (In Homarr)

Homarr RSS widgets **don't have built-in refresh intervals** - they fetch on page load.

### For Auto-Refreshing RSS:

**Option A: Browser Extension**
- Use "RSS Feed Reader" or "Feedly" browser extensions
- Auto-refresh every 15-30 minutes

**Option B: Custom Script (Advanced)**
```bash
# Add to crontab for RSS refresh
echo "*/15 * * * * curl -s http://localhost:7575/api/refresh" | crontab -
```

**Option C: Use FreshRSS/Miniflux Instead**
- Deploy FreshRSS: `https://freshrss.lemonlink.eu`
- Add to Homarr as app
- Better RSS management with automatic crawling

---

## 2️⃣ Prowlarr - Torrent/Usenet Indexing (Recommended)

If you want to index torrents/usenet for your *arr stack:

### Deploy Prowlarr

```yaml
# Add to your portainer-stack.yml
  prowlarr:
    container_name: prowlarr
    image: lscr.io/linuxserver/prowlarr:latest
    restart: unless-stopped
    volumes:
      - /opt/homarr/prowlarr:/config
    environment:
      - PUID=1000
      - PGID=1000
      - TZ=Europe/Stockholm
    ports:
      - '9696:9696'
    networks:
      - homarr-network
```

### Best Prowlarr Indexer Settings

**Global Settings → Indexers:**
```
Minimum Seeders: 1
Retention: 0 (unlimited)
Maximum Size: 0 (unlimited)
RSS Sync Interval: 15 minutes
```

**Applications (Sync to *arr apps):**
```
Sonarr: http://sonarr:8989
Radarr: http://radarr:7878
Lidarr: http://lidarr:8686
Readarr: http://readarr:8787
```

### Best Public Indexers (Free)

| Indexer | Type | Speed | Notes |
|---------|------|-------|-------|
| 1337x | Torrent | ⭐⭐⭐ | Reliable, good for movies |
| ThePirateBay | Torrent | ⭐⭐ | Hit or miss |
| RARBG | Torrent | ⭐⭐⭐ | Currently dead, avoid |
| Jackett | Meta | ⭐⭐⭐ | Aggregates many |
| YTS | Torrent | ⭐⭐ | Low quality, small size |

### Best Private Indexers (If you have access)
- BTN (TV)
- PTP (Movies)
- RED (Music)
- GazelleGames (Games)

---

## 3️⃣ Homarr Search & App Discovery

### Enable App Search

**Board Settings → Search:**
```
Enable Search: ✅
Include Apps: ✅
Include Widgets: ✅
Search Providers: All
```

### Keyboard Shortcuts
- `/` or `Ctrl+K` - Open search
- Type app name - Quick launch

### Best Icons for Auto-Discovery

When adding apps, use exact icon names:
```
proxmox → Uses Proxmox logo
sonarr → Uses Sonarr logo
plex → Uses Plex logo
portainer → Uses Portainer logo
```

---

## 4️⃣ Docker Integration (Auto-Discover Containers)

### Enable Docker Integration

1. **Manage → Integrations → New**
2. Type: **Docker**
3. Name: "Local Docker"
4. Socket: `/var/run/docker.sock` (already mounted)
5. Save

### Container Labels for Auto-Indexing

Add labels to your containers for Homarr to auto-detect:

```yaml
# Example container with Homarr labels
  myapp:
    image: myapp:latest
    labels:
      - "homarr.enabled=true"
      - "homarr.name=My App"
      - "homarr.icon=myapp"
      - "homarr.url=https://myapp.lemonlink.eu"
```

---

## 5️⃣ DNS/Ad Blocking Indexing (Pi-hole/AdGuard)

### Pi-hole Integration

1. **Manage → Integrations → New**
2. Type: **Pi-hole**
3. Host: `http://pihole.lemonlink.eu`
4. API Key: (from Pi-hole admin → Settings → API)
5. Save

### AdGuard Integration

1. **Manage → Integrations → New**
2. Type: **AdGuard**
3. Host: `http://adguard.lemonlink.eu`
4. Username/Password
5. Save

### DNS Hole Widget Settings
```
Show chart: ✅
Show statistics: ✅
Update interval: 60 seconds
```

---

## 6️⃣ Media Server Indexing (Plex/Jellyfin)

### Plex Integration

1. **Manage → Integrations → New**
2. Type: **Plex**
3. Host: `http://plex:32400` or `https://plex.lemonlink.eu`
4. API Key: (from Plex settings)
5. Save

### Jellyfin Integration

1. **Manage → Integrations → New**
2. Type: **Jellyfin**
3. Host: `http://jellyfin:8096`
4. API Key: (from Jellyfin admin → Advanced → API Keys)
5. Save

### Media Server Widget Settings
```
Show active streams: ✅
Show recently added: ✅
Update interval: 30 seconds
```

---

## 🏆 Recommended Complete Setup

### For RSS News:
```
Deploy: Miniflux or FreshRSS
Add to Homarr as app
Use RSS widget sparingly (slows page load)
```

### For Torrent/Usenet Indexing:
```
Deploy: Prowlarr + Jackett
Sync to: Sonarr, Radarr, Lidarr
Add to Homarr: App + Indexer Manager widget
```

### For App Discovery:
```
Enable: Docker integration
Use: Container labels for auto-discovery
Enable: Global search (Ctrl+K)
```

---

## ⚡ Quick Add to Your Stack

Want me to add Prowlarr to your `portainer-stack.yml`? Just let me know and I'll push the update!

Current setup works great - just add the integration in Homarr UI.