AI Crawler · Collection Records

Bot summary · Last 24 hours

Search Registration in a Day — Conquering Google, Naver, Daum, and Bing the Hard Way

A survivor's log of finishing search-engine registration with Google, Naver, Daum, and Bing in a single day — cleaning up 134 unindexed URLs, walking through each portal's steps, and fixing bots that were being counted as human.
Markdown source·Anything to add or correct?

"Google Search Console" and "Naver Search Advisor" used to be words from another world to me — fancy terms that flashed past when I browsed developer blogs.

The moment I opened Google Search Console with the innocent belief, "surely my site shows up in search?", a cold wind blew. Most of my posts were sitting there abandoned, with a cold notice reading "indexing failed."

The causes were clear. First, all sorts of junk URLs that must never appear in search (API endpoints, raw markdown files, pagination hell, graph data) were throwing the front door wide open. Second, because I never handed the portals a business card saying "I'm here," the AI bots simply walked past my domain (cursorai.co.kr).

There is no more room to retreat. Here is the real survival log of taking one day to tear through and clean up four major portals.


1. Google Search Console: Fighting 134 Ghost Pages

The moment I opened Search Console, what caught my eye were the 134 entries stuck under "Crawled — currently not indexed." For a second I doubted my eyes. Did I have this many posts? It turned out that more than half were URLs that would be embarrassing to expose in search.

  • /api/ (API call endpoints)
  • /board/ (board-related)
  • /page/ (pagination)
  • /*.md$ (raw markdown source files)

I summoned robots.txt and slammed the door on these addresses with a hard Disallow. The real posts had proper titles and bodies; the site is just so new that Google is still sizing it up. Trusting the saying "time will fix it," I let it be for now.


2. Naver Search Advisor: A Fortress That Won't Come Without an Invitation

Google at least finds its way over on its own, but Naver is a completely different world of scarcity. Since I hadn't even registered on Naver Search Advisor, the Naver bot's (Yeti) visit count was exactly 0. Knock on the door or it will never open.

  1. Go to searchadvisor.naver.com and log in.
  2. To pass the ownership verification gate, I used two methods at once — I tossed the naver5bdf….html file Naver handed me into the server root, and neatly planted a meta tag in the homepage <head>.
  3. Under Request > Submit sitemap, throw in https://cursorai.co.kr/sitemap.xml.
  4. Under Request > Submit RSS, throw in https://cursorai.co.kr/feed.xml.
  5. Under Request > Fetch web pages, enter the home address.

The curious part: the instant I submitted the sitemap, the Naver bot (Yeti) leapt up like clockwork and grabbed /sitemap.xml. Naver really does show results instantly, which gives a peculiar thrill.


3. Daum: An Analog-Style Single Application Form

Daum feels somehow old-school in its process(?).

  1. Go to register.search.daum.net and log in with a Kakao account.
  2. Confidently select "Site Search" in the new registration.
  3. Enter the title, URL, description, and description items, pressing each in firmly.
  4. Finding the category is a pain in the neck. I carefully set it to Study, Dictionary > Engineering > Computer Engineering > Artificial Intelligence.
  5. "Application complete. The result will be notified by email."

Now I just sip a coffee and wait for the inbox.


4. Bing: The Freeloading Trick Off Google (My Favorite)

Microsoft's Bing is the one that understands a developer's heart best.

  1. Go to bing.com/webmasters.
  2. The moment you log in, a "Import from Google Search Console" button catches your eye.
  3. The instant you click, ownership verification and sitemap submission are all skipped — the settings in Google are copied over with a free pass.

A system that skips the tedious steps in one shot — I commend it highly.


5. Bonus: The Bots Were Partying While Cosplaying as Humans

After finishing all the registrations, I compared the real-time traffic screen against the server logs and found something odd. The traffic stats showed humans coming in, but when I dug into the actual server logs, they were all AI crawlers and search bots.

ShapBot, which was slickly scanning the server, and Naver's Yeti were being counted as noble "human visitors" inside my stats program. The moment I added these guys to the crawler list and restarted the server, the real-time visitor count was corrected from 3 down to a lonely but honest 1 (me). Hey bots, stop inflating my visitor count….


6. Current Status Summary

  • Google: Unindexed debris cleaned up neatly, validation in progress 🚀
  • Naver: Yeti is sweeping up the sitemap and RSS, kicking off full activity 🐾
  • Bing: bingbot naturally began collecting right after Google 🤖
  • Daum: Application submitted, waiting calmly ☕

If there is anyone still putting off Search Console or Search Advisor, I recommend taking one hard day to clean it all up. Just watching the logs of bots finding your site is enough to give you a peculiar thrill.

Visitor Comments

Loading…