Feat/cleanup and admin features (#1326)

* feat: unified tag system with Medium-style UX and admin dashboard

  - Extend tag schema with slug, description, and cached postCount
  - Add tag_merge_suggestions table for AI-powered duplicate detection
  - Enhance TagInput with autocomplete showing post counts
  - Add PopularTagsSidebar component for feed filtering
  - Implement tag filtering in feed via URL params (?tag=javascript)
  - Create admin dashboard at /admin/tags with:
    - Searchable/sortable tag table
    - Tag editing (title, slug, description)
    - Merge mode for consolidating duplicate tags
    - AI merge suggestions panel (ready for integration)
  - Add migration to convert RSS source categories to tags
  - Add tag.search, tag.getPopular, tag.getOrCreate API endpoints
  - Add admin endpoints: getAdminStats, update, mergeTags, recalculateCounts

* feat: enhance admin dashboard with new stats and logo upload functionality

* fix: restore notifications functionality and update card styling

  - Add missing postId and commentId to notification inserts in comment
    and discussion routers
  - Update notification table foreign keys to reference new posts/comments
    tables instead of legacy Post/Comment tables
  - Change postId column type from text to uuid and commentId from integer
    to uuid to match new table schemas
  - Update notification cards with modern grey/white styling (rounded
    corners, proper borders, hover effects)
  - Add E2E tests for notification display and creation flow
  - Add seed script for testing notifications locally

* feat: add JSON-LD structured data for SEO and improve admin sources UI

Add JsonLd component and structured data schemas (Article, NewsArticle, Person, Organization, WebSite, Breadcrumb)
Integrate JSON-LD into homepage, layout, user profiles, and article pages
Update robots.txt to block problematic paths and allow AI crawlers (GPTBot, Claude-Web, PerplexityBot, etc.)
Add data completeness badge to admin sources showing missing fields
Improve admin sources action button styling
Remove debug blue background from table styles

* Refactor code for improved readability and consistency

- Added missing newline at the end of _journal.json file.
- Simplified import statements in notifications.spec.ts and structured-data/index.ts for better clarity.
- Reformatted code in seed-notifications.ts for consistent indentation and readability.
- Enhanced readability of import statements in content.ts and tag.ts by aligning them properly.
- Updated test expectations in notifications.spec.ts to improve clarity and maintainability.

* chore: remove outdated development test suite documentation

* fix: update notification migration to convert column types before adding FK constraints

The migration was failing because postId (text) and commentId (integer)
couldn't reference posts.id and comments.id (both uuid). This updates the
migration to:
- Convert postId from text to uuid using legacy_post_id lookup
- Convert commentId from integer to uuid using legacy_comment_id lookup
- Make the migration idempotent (safe to run multiple times)
- Update snapshot to reflect the new column types

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* test: enhance e2e tests with load state waits and improve visibility checks

* test: enhance e2e tests by waiting for TRPC responses to improve reliability

* refactor: streamline error handling and improve test reliability across actions and notifications

* test: improve notification and article tests by enhancing reliability and reducing dependency on TRPC responses

* test: enhance reliability of article bookmarking and loading tests by waiting for network idle state

* refactor: update load state waits from "networkidle" to "domcontentloaded" for improved test reliability

* Fix E2E test failures and hide banned users' posts from feeds

Fix editor "Saved" indicator for new posts by setting savedTime in the
CREATE branch. Add test.slow() for Firefox publish test timeout. Replace
force-click bookmark buttons with proper TRPC mutation response waits.

Hide banned users' posts by updating status to draft on ban and restoring
on unban. Add defense-in-depth LEFT JOIN on banned_users to post and feed
query endpoints.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* Fix Prettier formatting in E2E test files

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>

Author: NiallJoeMaher

.claude/commands/do-test.md

@@ -1,3 +1,4 @@
 {
-  "typescript.tsdk": "node_modules/typescript/lib"
+  "typescript.tsdk": "node_modules/typescript/lib",
+  "snyk.advanced.autoSelectOrganization": true
 }

.vscode/settings.json

@@ -21,19 +21,6 @@ type Props = {
   contentSlug: string;
 };
 
-// Get favicon URL from a website
-const getFaviconUrl = (
-  websiteUrl: string | null | undefined,
-): string | null => {
-  if (!websiteUrl) return null;
-  try {
-    const url = new URL(websiteUrl);
-    return `https://www.google.com/s2/favicons?domain=${url.hostname}&sz=32`;
-  } catch {
-    return null;
-  }
-};
-
 // Get hostname from URL
 const getHostname = (urlString: string): string => {
   try {
@@ -189,7 +176,6 @@ const UserLinkDetail = ({ username, contentSlug }: Props) => {
       })
     : null;
 
-  const faviconUrl = getFaviconUrl(externalUrl);
   const hostname = externalUrl ? getHostname(externalUrl) : null;
   const score = votes.upvotes - votes.downvotes;
 

app/(app)/[username]/[slug]/_userLinkDetail.tsx

@@ -24,6 +24,12 @@ import { eq, and, lte } from "drizzle-orm";
 import FeedArticleContent from "./_feedArticleContent";
 import LinkContentDetail from "./_linkContentDetail";
 import UserLinkDetail from "./_userLinkDetail";
+import { JsonLd } from "@/components/JsonLd";
+import {
+  getArticleSchema,
+  getBreadcrumbSchema,
+  getNewsArticleSchema,
+} from "@/lib/structured-data";
 
 type Props = { params: Promise<{ username: string; slug: string }> };
 
@@ -457,8 +463,40 @@ const UnifiedPostPage = async (props: Props) => {
       }) as unknown as string;
     }
 
+    // Prepare JSON-LD structured data
+    const articleSchema = getArticleSchema({
+      title: userPost.title,
+      excerpt: userPost.excerpt,
+      slug: userPost.slug,
+      publishedAt: userPost.published,
+      updatedAt: userPost.updatedAt,
+      readingTime: userPost.readTimeMins,
+      canonicalUrl: userPost.canonicalUrl,
+      tags: userPost.tags.map((t) => ({ title: t.tag.title })),
+      author: {
+        name: userPost.user.name,
+        username: userPost.user.username,
+        image: userPost.user.image,
+        bio: userPost.user.bio,
+      },
+    });
+
+    const breadcrumbSchema = getBreadcrumbSchema([
+      { name: "Home", url: "https://www.codu.co" },
+      { name: "Feed", url: "https://www.codu.co/feed" },
+      {
+        name: userPost.user.name || "Author",
+        url: `https://www.codu.co/${userPost.user.username}`,
+      },
+      { name: userPost.title },
+    ]);
+
     return (
       <>
+        {/* JSON-LD Structured Data for SEO */}
+        <JsonLd data={articleSchema} />
+        <JsonLd data={breadcrumbSchema} />
+
         <div className="mx-auto max-w-3xl px-4 py-8">
           {/* Breadcrumb navigation */}
           <nav className="mb-6 flex items-center gap-2 text-sm text-neutral-500 dark:text-neutral-400">
@@ -618,8 +656,40 @@ const UnifiedPostPage = async (props: Props) => {
       }) as unknown as string;
     }
 
+    // Prepare JSON-LD structured data
+    const articleSchema = getArticleSchema({
+      title: userArticle.title,
+      excerpt: userArticle.excerpt,
+      slug: userArticle.slug,
+      publishedAt: userArticle.publishedAt,
+      updatedAt: userArticle.updatedAt,
+      readingTime: userArticle.readTimeMins,
+      canonicalUrl: userArticle.canonicalUrl,
+      tags: userArticle.tags?.map((t) => ({ title: t.tag.title })),
+      author: {
+        name: userArticle.user.name,
+        username: userArticle.user.username,
+        image: userArticle.user.image,
+        bio: userArticle.user.bio,
+      },
+    });
+
+    const breadcrumbSchema = getBreadcrumbSchema([
+      { name: "Home", url: "https://www.codu.co" },
+      { name: "Feed", url: "https://www.codu.co/feed" },
+      {
+        name: userArticle.user.name || "Author",
+        url: `https://www.codu.co/${userArticle.user.username}`,
+      },
+      { name: userArticle.title },
+    ]);
+
     return (
       <>
+        {/* JSON-LD Structured Data for SEO */}
+        <JsonLd data={articleSchema} />
+        <JsonLd data={breadcrumbSchema} />
+
         <div className="mx-auto max-w-3xl px-4 py-8">
           {/* Breadcrumb navigation */}
           <nav className="mb-6 flex items-center gap-2 text-sm text-neutral-500 dark:text-neutral-400">
@@ -773,16 +843,78 @@ const UnifiedPostPage = async (props: Props) => {
   const feedArticle = await getFeedArticle(username, slug);
 
   if (feedArticle) {
-    // Render feed article
-    return <FeedArticleContent sourceSlug={username} articleSlug={slug} />;
+    // Prepare JSON-LD structured data for feed article
+    const newsArticleSchema = getNewsArticleSchema({
+      title: feedArticle.title,
+      excerpt: feedArticle.excerpt,
+      slug: feedArticle.slug,
+      externalUrl: feedArticle.externalUrl || "",
+      coverImage: feedArticle.imageUrl || feedArticle.ogImageUrl,
+      publishedAt: feedArticle.publishedAt,
+      source: {
+        name: feedArticle.source?.name || null,
+        slug: feedArticle.source?.slug || username,
+        logoUrl: feedArticle.source?.logoUrl,
+      },
+    });
+
+    const breadcrumbSchema = getBreadcrumbSchema([
+      { name: "Home", url: "https://www.codu.co" },
+      { name: "Feed", url: "https://www.codu.co/feed" },
+      {
+        name: feedArticle.source?.name || username,
+        url: `https://www.codu.co/${feedArticle.source?.slug || username}`,
+      },
+      { name: feedArticle.title },
+    ]);
+
+    // Render feed article with JSON-LD
+    return (
+      <>
+        <JsonLd data={newsArticleSchema} />
+        <JsonLd data={breadcrumbSchema} />
+        <FeedArticleContent sourceSlug={username} articleSlug={slug} />
+      </>
+    );
   }
 
   // Try unified content table (new LINK type items)
   const linkContent = await getLinkContent(username, slug);
 
   if (linkContent) {
-    // Render link content
-    return <LinkContentDetail sourceSlug={username} contentSlug={slug} />;
+    // Prepare JSON-LD structured data for link content
+    const newsArticleSchema = getNewsArticleSchema({
+      title: linkContent.title,
+      excerpt: linkContent.excerpt,
+      slug: linkContent.slug,
+      externalUrl: linkContent.externalUrl || "",
+      coverImage: linkContent.imageUrl || linkContent.ogImageUrl,
+      publishedAt: linkContent.publishedAt,
+      source: {
+        name: linkContent.source?.name || null,
+        slug: linkContent.source?.slug || username,
+        logoUrl: linkContent.source?.logoUrl,
+      },
+    });
+
+    const breadcrumbSchema = getBreadcrumbSchema([
+      { name: "Home", url: "https://www.codu.co" },
+      { name: "Feed", url: "https://www.codu.co/feed" },
+      {
+        name: linkContent.source?.name || username,
+        url: `https://www.codu.co/${linkContent.source?.slug || username}`,
+      },
+      { name: linkContent.title },
+    ]);
+
+    // Render link content with JSON-LD
+    return (
+      <>
+        <JsonLd data={newsArticleSchema} />
+        <JsonLd data={breadcrumbSchema} />
+        <LinkContentDetail sourceSlug={username} contentSlug={slug} />
+      </>
+    );
   }
 
   // Nothing found

app/(app)/[username]/[slug]/page.tsx

@@ -7,6 +7,8 @@ import { type Metadata } from "next";
 import { db } from "@/server/db";
 import { feed_sources } from "@/server/db/schema";
 import { eq } from "drizzle-orm";
+import { JsonLd } from "@/components/JsonLd";
+import { getPersonSchema } from "@/lib/structured-data";
 
 type Props = { params: Promise<{ username: string }> };
 
@@ -133,8 +135,20 @@ export default async function Page(props: {
       accountLocked,
     };
 
+    // Prepare Person JSON-LD for SEO
+    const personSchema = getPersonSchema({
+      name: shapedProfile.name,
+      username: shapedProfile.username,
+      image: shapedProfile.image,
+      bio: shapedProfile.bio,
+      websiteUrl: shapedProfile.websiteUrl,
+    });
+
     return (
       <>
+        {/* Person JSON-LD for profile SEO */}
+        <JsonLd data={personSchema} />
+
         <h1 className="sr-only">{`${shapedProfile.name || shapedProfile.username}'s Coding Profile`}</h1>
         <Content profile={shapedProfile} isOwner={isOwner} session={session} />
       </>

app/(app)/[username]/page.tsx

@@ -7,7 +7,7 @@ import {
   FlagIcon,
   RssIcon,
   ShieldExclamationIcon,
-  NewspaperIcon,
+  TagIcon,
 } from "@heroicons/react/24/outline";
 import { api } from "@/server/trpc/react";
 
@@ -99,13 +99,6 @@ const AdminDashboard = () => {
           color="green"
           isLoading={isLoading}
         />
-        <StatCard
-          title="Aggregated Articles"
-          value={stats?.aggregatedArticles}
-          icon={NewspaperIcon}
-          color="purple"
-          isLoading={isLoading}
-        />
         <StatCard
           title="Active Feed Sources"
           value={stats?.activeFeedSources}
@@ -114,6 +107,14 @@ const AdminDashboard = () => {
           href="/admin/sources"
           isLoading={isLoading}
         />
+        <StatCard
+          title="Total Reports"
+          value={reportCounts?.total}
+          icon={FlagIcon}
+          color="purple"
+          href="/admin/moderation"
+          isLoading={isLoading}
+        />
       </div>
 
       {/* Moderation Stats */}
@@ -205,6 +206,21 @@ const AdminDashboard = () => {
               </p>
             </div>
           </Link>
+
+          <Link
+            href="/admin/tags"
+            className="flex items-center gap-3 rounded-lg border border-neutral-200 bg-white p-4 transition-colors hover:border-green-300 hover:bg-green-50 dark:border-neutral-700 dark:bg-neutral-800 dark:hover:border-green-700 dark:hover:bg-green-900/20"
+          >
+            <TagIcon className="h-6 w-6 text-green-500" />
+            <div>
+              <p className="font-medium text-neutral-900 dark:text-white">
+                Tag Management
+              </p>
+              <p className="text-sm text-neutral-500 dark:text-neutral-400">
+                Merge, curate, and manage tags
+              </p>
+            </div>
+          </Link>
         </div>
       </div>
     </div>

app/(app)/admin/_client.tsx

@@ -4,7 +4,6 @@ import { useState } from "react";
 import Link from "next/link";
 import {
   FlagIcon,
-  CheckCircleIcon,
   XCircleIcon,
   ExclamationTriangleIcon,
   ArrowLeftIcon,