Commit Graph

296 Commits

Author SHA1 Message Date
8b6057aef2 feat(patching/import): filtre intervenant en dropdown, retire filtre asset texte, ajoute tri asc/desc/none au clic sur entete Asset 2026-05-04 13:17:23 +02:00
488b5a980b feat(patching/import): ajout colonnes Resp Domaine DTS, Referent technique, Mode operatoire, Impacts, BDD - support nouveau format S07+ + Date au lieu de Jour 2026-05-04 13:12:09 +02:00
13a5625710 feat(patching/import): filtres client-side asset/intervenant/env sur tableau semaine 2026-05-04 13:04:05 +02:00
557015325b feat(patching): import planning xlsx (etape 1) - tables patch_planning_imports + rows, page upload + selecteur semaine + tableau 2026-05-04 12:57:35 +02:00
983552a442 fix(qualys/agents): message d'echec specifique selon cause reelle (DNS/TCP timeout/TCP refused/SSH auth) - plus de 'agent installe? OS supporte?' generique 2026-04-28 02:00:21 +02:00
532549072d fix(qualys/agents): lien fiche serveur 404 - remplace par recherche Qualys du host 2026-04-28 01:55:25 +02:00
767b33095a feat(qualys/agents): bloque troubleshooting pour Windows (route + bouton 'Non gere' dans table) 2026-04-28 01:48:32 +02:00
eecb61c720 fix(qualys/agents): check service multi-format - SysV init francais (en cours d'execution / (pid X)) en plus de systemd active (running) 2026-04-28 01:45:48 +02:00
f0043eb481 ui(qualys/agents): separation RHEL5 (early exit, decom) vs RHEL6 (agent legacy ok, CA bundle a jour) 2026-04-28 01:33:10 +02:00
4db0cf6a56 ui(qualys/agents): si OS EOL (RHEL 5/6) - affiche seule entree 'agent legacy, decom prevu', pas de warnings redondants 2026-04-28 01:31:25 +02:00
b6a602e848 ui(qualys/agents): wording diag prudent (constat/hypothese/proposition vers ticket support, pas affirmer) 2026-04-28 01:27:42 +02:00
67bd3a02d6 ui(qualys/agents): bloc Etat checklist OK/KO en tete (connectivite/disque/service/install) + log systeme 10 lignes 2026-04-28 01:24:57 +02:00
7f8c2c710b ui(qualys/agents): renomme 'Suggestions' en 'Diagnostic' + reformulation orientee constat (pas de cmds shell, oriente vers ticket support) 2026-04-28 01:23:56 +02:00
5abc474805 perf(qualys/agents): combine toutes les cmds en 1 seul channel SSH avec markers - evite Timeout opening channel sur PSMP 2026-04-28 01:18:59 +02:00
d4205fb8f8 fix(qualys/agents): retry avec reconnect SSH si Timeout opening channel (limite channels PSMP) 2026-04-28 01:14:03 +02:00
fc480b4376 ui(qualys/agents): retire bloc Configuration proxy agent (inutile car SANEF prod sort en direct, pas via proxy) 2026-04-28 01:13:18 +02:00
49c700c5d1 fix(qualys/agents): procedure reinstall reelle SANEF (rpm -ivh /root/QualysCloudAgent.rpm) 2026-04-28 00:58:45 +02:00
79cff850d3 feat(qualys/agents): suggestion auto pour install cassee (core dump + package absent RPM/DPKG) 2026-04-28 00:57:06 +02:00
fb448257a1 ui(qualys/agents): connectivite minimale - HTTP code recu = OK, diag detaille seulement si KO 2026-04-28 00:52:17 +02:00
c54ec0ba0c fix(qualys/agents): test connectivite DIRECT vers qagpublic.qg1.apps.qualys.eu (pod EU1 SANEF) - pas de proxy car agent sort en direct 2026-04-28 00:26:29 +02:00
9d312f43a3 feat(qualys/agents): check conf proxy agent (qagent-proxy.conf, drop-in systemd, sysconfig, /etc/environment) + suggestion config proxy 2026-04-28 00:20:56 +02:00
191c167423 fix(qualys/agents): snapshot vCenter (pas LVM) pour rollback avant extend FS 2026-04-28 00:15:12 +02:00
640292c1ce feat(qualys/agents): checks LVM + logrotate + suggestions extend FS / cleanup / fix logrotate avec snapshot LVM obligatoire 2026-04-28 00:11:45 +02:00
b81343d5ca fix(qualys/agents): test connectivite via proxy SANEF (proxy.sanef.fr:8080, fallback IP 10.40.10.225) + suggestion conf agent 2026-04-28 00:06:32 +02:00
71a2927e15 ui(qualys/agents): highlight rouge >=90% / orange >=75% sur lignes df dans bloc disque 2026-04-28 00:01:46 +02:00
a877589cf3 feat(qualys/agents): suggestions auto resolution selon patterns logs (disque sature, crash loop, conn KO, service masked, agent obsolete) 2026-04-28 00:01:14 +02:00
54a2a59991 ui(qualys/agents): renomme bouton Check en Troubleshooting 2026-04-27 23:54:29 +02:00
437b1ed172 feat(qualys/agents): ajout checks espace disque + connectivite console Qualys (qualysagent/qualysguard.qualys.eu) 2026-04-27 23:53:15 +02:00
d9be39a037 fix(qualys/agents): sudo -n explicite pour lire logs Qualys (fichiers root-only) + fallback messages 'existe mais non lisible' 2026-04-27 23:39:53 +02:00
cdcb85917d feat(qualys/agents): audit en background thread + page d'attente auto-refresh (fix ERR_CONNECTION_RESET sur audits longs) 2026-04-27 23:25:50 +02:00
26e05d63ac fix(qualys/agents): commandes audit adaptees multi-OS (RHEL5 SysV init, journalctl absent, chemins log Qualys multiples) 2026-04-27 23:15:50 +02:00
03229d4d08 feat(qualys/agents): bouton Check + page audit cible Qualys agent (status + version + logs agent/systeme via SSH) 2026-04-27 23:09:05 +02:00
dc9c197274 fix(qualys/dashboard): timeout 120s->300s + log erreurs sur _fetch_asset_ids_by_tag (manque ENV-PRD/REC sur gros tags) 2026-04-27 23:00:58 +02:00
5ec5271232 perf(qualys/dashboard): parallelise fetch vulns par batch IPs (8 workers, ~18min -> ~3min) 2026-04-27 17:15:44 +02:00
ad630eba99 feat(qualys/agents): tri click-to-sort sur toutes les tables (hostname, OS, check-in, etc.) 2026-04-27 16:58:06 +02:00
4bc9d6cc61 docs(qualys/duplicates): message bandeau ~1200 serveurs 2026-04-25 19:56:51 +00:00
0d4ce6dfc2 feat(qualys/duplicates): scan filtre Linux+Windows Server uniquement (~1200 vs 6244) 2026-04-25 19:56:23 +00:00
2c5c0df355 docs(qualys/duplicates): clarifie message bandeau (6000 scan total, 1300 serveurs filtres) 2026-04-25 11:05:36 +00:00
6c52d05393 fix(qualys/duplicates): renomme cle items -> groups (conflit Jinja avec dict.items) 2026-04-25 10:49:53 +00:00
cc550c2d84 fix(qualys/duplicates): scan async (background thread) + bandeau scan en cours - evite 503 HAProxy 2026-04-25 10:31:07 +00:00
e832381b68 feat(qualys/duplicates): filtre serveurs uniquement (exclut Win 10/11/7/8/XP postes) 2026-04-25 10:23:14 +00:00
3d043af194 feat(qualys): page doublons + suppression API Qualys 1-clic 2026-04-25 10:17:40 +00:00
8f406f211d feat(qualys/dashboard): compute v2 - interroge API Qualys par tag (DB locale qualys_asset_tags souvent obsolete) 2026-04-25 00:42:29 +00:00
54c10d90de fix(qualys/dashboard): bandeau plus voyant (gradient cyan + glow) 2026-04-25 00:27:01 +00:00
66558c4b46 fix(qualys/dashboard): compteur base sur running_since DB (survit aux auto-refresh) 2026-04-25 00:16:44 +00:00
0ab4f2d8fa fix(qualys/dashboard): vire flag in-memory + safety net thread + flex layout 6 KPI 2026-04-25 00:13:22 +00:00
34cca6f77b fix(qualys/dashboard): user est un dict, utiliser user.get(sub) au lieu de .username 2026-04-25 00:09:15 +00:00
9a7f446637 fix(qualys/dashboard): insert pending row dans la route avant spawn thread (no race) 2026-04-25 00:07:22 +00:00
daf87891a7 feat(qualys/dashboard): is_running base sur DB (multi-worker safe) + bouton Annuler 2026-04-25 00:05:49 +00:00
17f508c1d1 feat(qualys/dashboard): bandeau spinner persistant + auto-refresh pendant recalcul 2026-04-24 23:55:24 +00:00
8f8e8c4d8f feat(qualys): dashboard vulnerabilites avec KPI + historique 2026-04-24 23:49:46 +00:00
b06aedfc3b fix(qualys): force vuln cache refresh on bulk resync redirect 2026-04-24 22:51:11 +00:00
392c8f4fe5 fix(qualys/search): KPI vuln_map est dict total/severityN, pas int 2026-04-24 22:34:16 +00:00
3c00f05263 feat(qualys/agents): colonne Version OS dans table sans-agent 2026-04-24 22:30:39 +00:00
c57ef61adb feat(qualys/search): KPI total/avec-vuln/sans-vuln + filtre vuln_filter 2026-04-24 22:27:55 +00:00
c258d6091a fix(qualys): resync_all_tags HTTP 400 - limitResults 10000 trop grand, capper a 1000
Qualys QPS API rejette limitResults au-dela de 1000 (HTTP 400 Bad Request).
Aligne sur les autres requetes du service (5, 20, 100, 200, 1000) et sur
qualys_tags_service.list_qualys_tags qui utilise deja 1000.

Reproductible via /qualys/tags > bouton Resync (msg=resync_ko_HTTP+400).
2026-04-23 12:19:31 +00:00
5fedfb5f80 Add page Tour de garde SecOps : import xlsx + table + vue hebdo + competences 2026-04-17 23:39:11 +00:00
9a72fa7eb7 Optim: fix N+1 queries itop_service (pre-load batch) + macros Jinja2 badges 2026-04-17 23:23:32 +00:00
a0f90cd719 Optim: logging structure + query_helpers.py + fix exceptions silencieuses routers 2026-04-17 23:19:18 +00:00
9097872e57 Secu: verif permissions can_view/can_edit sur endpoints HTMX detail/edit 2026-04-17 23:15:04 +00:00
2bf2fa5042 patch_history: tolere parametres vides dans les filtres (week=, source=, etc.) 2026-04-17 12:42:58 +00:00
2ab2ceabba Historique patching : filtres OS/zone/domaine/intervenant + colonnes table 2026-04-17 12:10:45 +00:00
cfb9cf865c Register patch_history router in main.py 2026-04-17 09:41:14 +00:00
4b1794d4d1 Add page Historique patching : vue unifiee import xlsx + campagnes + quickwin 2026-04-17 08:47:25 +00:00
MOUTAOUAKIL-ext Khalid
e2fb34f115 Sync SANEF : audit_service + schema.sql + data deploy + gitignore 2026-04-17 09:20:57 +02:00
1c661e2dc5 qualys_tags: respect qualys_bypass_proxy flag
_get_creds() ignorait le flag bypass_proxy et retournait toujours
qualys_proxy meme si l'utilisateur avait coche bypass en settings.
Comportement desormais aligne avec qualys_service._get_qualys_creds().
2026-04-17 00:28:57 +02:00
617bf94e31 Qualys agents sync: optims perf majeures (~3-5x plus rapide)
Refactor _refresh_all_agents_impl() avec 4 optimisations:

1. Pre-chargement des servers en dict Python au debut (hostname + IP)
   -> elimine 2 queries SQL par asset (gain principal)

2. UPSERT 'INSERT ... ON CONFLICT DO UPDATE' + RETURNING (xmax=0)
   -> une seule query au lieu de SELECT + INSERT/UPDATE
   -> compte created/updated via xmax

3. HTTP Session reutilisee (requests.Session)
   -> keep-alive, pas de handshake SSL a chaque page

4. ThreadPoolExecutor(5) pour executer les 5 filtres tagName en parallele
   -> dedup par asset_id pour eviter traitement double

Bonus:
- max_pages 30 -> 500 par filtre (evite syncs incomplets silencieux)
- FQDN backfill cible via cache 'servers_need_fqdn' (pas d'UPDATE inutile)
- Commit unique en fin de traitement (suppression savepoint par asset)
- Retrait age-check redondant en mode diff (deja filtre cote API)
2026-04-16 23:34:51 +02:00
f1a1ca9c7b Qualys Tags V3: unescape entites XML dans ruleText/name
Qualys renvoie les entites XML dans ruleText deja echappees (Bip&Go,
<?xml...). Jinja auto-escape les ressortait en double (<...).
Unescape iteratif (jusqu'a 3 passes) pour couvrir le double-escape.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-15 15:40:04 +02:00
79a2cc896e Qualys diff: format ISO sans microsec YYYY-MM-DDTHH:MM:SSZ (compat API QPS) 2026-04-15 14:28:57 +02:00
7924e64616 Qualys diff: filtre 'updated' (searchable) au lieu de 'lastCheckedIn' (non recunu API) 2026-04-15 14:06:27 +02:00
8b212df7a1 Qualys 'sans agent': match via server_id (couvre alias hostname Qualys != iTop) 2026-04-15 13:54:07 +02:00
245777fd46 Qualys agents: exclut Win10/11/Workstation de la liste 'Sans agent' 2026-04-15 13:49:05 +02:00
4a5a1f6716 Qualys: bouton Sync complete vert (#22c55e) bien visible 2026-04-15 13:42:58 +02:00
6824fee081 Qualys deploy UI: ActivationId/CustomerId masques (type password) + toggle œil 2026-04-15 13:37:15 +02:00
a3a1ec7e6d Qualys deploy: bouton 'Sauvegarder ces valeurs' (ActivationId/Customer/Uri persistes) 2026-04-15 13:34:24 +02:00
0ebf72d789 Qualys diff sync: sauve le timestamp DES LE DEBUT (resilient si annulation) 2026-04-15 13:29:36 +02:00
5b6e113792 Qualys deploy: filtre s.os_family=linux + retire dropdown OS du UI 2026-04-15 13:18:09 +02:00
206cc813f6 Qualys deploy: simplifie UI = ActivationId Linux uniquement (Windows hidden, persiste backend) 2026-04-15 13:14:23 +02:00
55d08921f9 Qualys deploy: persiste activation_ids/customer/uri en secrets + selection auto Linux/Windows 2026-04-15 13:12:15 +02:00
f59c6dcbdb Qualys deploy: 2 dropdowns ActivationId Linux et Windows (separes) 2026-04-15 13:04:34 +02:00
0095f7914f Qualys deploy: POD SANEF = QG1 par defaut (pas QG2) 2026-04-15 13:00:45 +02:00
2972baca1f Qualys deploy: dropdown ActivationId depuis API + ServerUri auto-deduit URL Qualys 2026-04-15 12:53:18 +02:00
935c8003b4 Qualys sync: retry 3x avec backoff sur erreurs transitoires proxy/reseau 2026-04-15 12:44:49 +02:00
9e03fd84c0 Qualys tags page: bandeau sync en cours + bouton Resync API disable 2026-04-15 12:39:40 +02:00
48249d1c82 Qualys agents page: bandeau sync en cours + boutons sync desactives + bouton Annuler 2026-04-15 12:37:49 +02:00
1dc7560f44 Qualys tags resync: message clair si busy + erreur API detaillee 2026-04-15 12:35:34 +02:00
a62f9a4146 Qualys sync dual mode: diff (rapide, lastCheckedIn) + full (complet)
- refresh_all_agents accepte mode='diff'|'full' (defaut diff)
- Mode diff: filtre Qualys lastCheckedIn > qualys_last_diff_sync (settings)
- Mode full: pull tous les assets (comme avant)
- Skip early-exit en diff si dernier diff < 5 min
- 2 boutons UI: 'Sync rapide (diff)' et 'Sync complete'
- JS refreshAgents(mode) passe le mode en query param
2026-04-15 12:33:48 +02:00
55f81de986 Qualys sync: fallback matching par IP integrer si hostname ne match pas 2026-04-15 12:25:27 +02:00
0dc9b07edd audit _run: retry sans sudo accepte sortie vide (pas containers/failed = OK, pas erreur) 2026-04-15 12:18:35 +02:00
1a1af9e28a Qualys sync multi-pass: filtres SRV/server/SED/SEI/EMV pour couvrir tags heterogenes 2026-04-15 12:17:02 +02:00
2746188f1c audit _run: detection sudo refused plus robuste (accent-insensitive, sudo:, no tty) 2026-04-15 12:12:22 +02:00
2f880da275 Top bar: affiche display_name (Prenom NOM) + (AD) si LDAP + login en gris 2026-04-15 12:00:41 +02:00
67fa28a2af Fix LDAP auto-provision: colonne display_name (pas full_name) 2026-04-15 11:52:20 +02:00
f013aaaab6 LDAP auto-provision: user cree DESACTIVE par defaut + role viewer (admin doit l'activer) 2026-04-15 11:46:22 +02:00
53d4f71607 LDAP: restriction groupe AD + auto-provisioning users (sans permissions)
- Settings ldap_required_group (DN groupe autorise) + ldap_default_role
- ldap_authenticate verifie memberOf vs required_group avant bind
- auth.py: si user inconnu + LDAP + groupe OK -> auto-create user, role default,
  zero permission (admin doit assigner via /users)
2026-04-15 11:45:33 +02:00
52e859ba08 Sidebar: ajoute liens Tags V3 (vue / catalogue / gap) sous Qualys > Tags 2026-04-15 10:23:58 +02:00
d508072969 Add /qualys/tagsv3/catalog: page de reference nom/type/QQL/couleur par categorie
- Template catalog.html affiche les 6 categories + prefixes
- Tags avec QQL en font mono user-select:all pour copy-paste facile
- Export JSON dispo via /qualys/tagsv3/catalog.json
- Navigation croisee entre Vue/Catalog/Gap
2026-04-15 10:20:41 +02:00
ec7712f0c9 Add module Qualys Tags V3: catalogue YAML + service + pages /qualys/tagsv3 et /gap
- deploy/qualys_tags_v3.yaml: catalogue 19 DYN + 6 SPEC manuel + prefixes
- app/services/qualys_tags_service.py: list/analyze_gap/create_static/delete via API
- app/routers/qualys_tags.py: routes /qualys/tagsv3 et /gap
- templates: qualys_tagsv3.html (liste) + qualys_tagsv3_gap.html (diff catalogue)
- Route /qualys/tagsv3/create-all-static pour creer les STAT manquants en bulk
- DYN manquants affiches avec QQL copy-paste pour console Qualys (API ne permet pas)
- PyYAML ajoute aux requirements
2026-04-15 10:14:10 +02:00
105a756008 Qualys hostname: retour a priorite name (sauf IP/localhost/vide), fqdn/netbios en fallback 2026-04-15 01:38:56 +02:00
c7291d3e6d Qualys _parse_assets_full: hostname FQDN > NetBIOS > name (fix aussi cette fonction) 2026-04-15 01:20:28 +02:00