Improve your website's visibility on Google through crawl budget optimization

crawlOPTIMIZER is a new SEO software tool that helps you with optimizing your crawl budget, so that you are able to use/control Googlebot in the most precise and efficient way through your own website.

XXXLUTZ
Baby Walz
Mömax
PLANET SPORTS
Möbelix
21run

Log File Analysis Tool from an SEO Perspective

Do you know which content of your website is beeing crawled by Googlebot? No?

Then you should have a deeper look into this tool – check it out!

The cloud based tool crawlOPTIMIZER gives you exact information, which of your website’s content is crawled by Google by means of your log files.

 

Based on predefined analyses & evaluations crawlOPTIMIZER shows you unknown SEO potentials for maximizing crawl-efficiency, so you are able to always feed Google index updated content as fast as possible. Get more unpaid search engine traffic.

John Müller

Webmaster Trends Analyst bei Google

“Log files are so underrated, so much good information in them.” (Twitter)

John Müller

Dashboard crawlOPTIMIZER

crawlOPTIMIZER analyzes & saves log files automactially

crawlOPTIMIZER analyzes Googlebot log files fully automated and files them on a secured server in Germany up to 5 years long. Our simply arranged crawlOPTIMIZER dashboard allows you to monitor Googlebot activities 24/7. Due to the saving of log files and our specially developed logfile explorer even retroactive analyses are possible at any given time.
Ready-to-use evaluations

Predefined analyses & evaluations help even new to the subject SEO users to easily discover crawling difficulties.

Server location Germany & 100% GDPR-compliant

Only Googlebot log files will be analyzed & filed – no user related data! All GDPR requirements are met.

For whom was crawlOPTIMIZER developed for?

Log file analyses made under an SEO aspect offer every digital marketer unknown potential for optimization.

1. Zielgruppe

crawlOPTIMIZER is for everyone that is responsible for unpaid search engine traffic in a company and doesn’t have a lot of time for detailed log file analyses or specific knowledge.

• Head of SEO
• SEO-Managers
• Head of Online Marketing
• Online Marketing Managers
• Head of E-Commerce
• e-Commerce Manager
• Webmaster / IT-Admins
• SEO-agencies

2. Websites

crawlOPTIMIZER was specifically developed for websites that contains a few thousand pages or online ventures with a big interest in increasing their unpaid search engine traffic.


• Web shops / online shops
• E-Commerce websites
• Informational websites
• News / weather portals
• Big blogs / forums

Why do I need crawlOPTIMIZER?

A simple explanation of an SEO process

Without crawling there is no indexation and thus no google search engine ranking.

Your website can only be found via Google search, if it has been added to the Google-Index. Because of this Googlebot (also called Spider) crawls every available website worldwide daily searching for new and updated content.

By using various onsite optimization measures you are able to influence this crawling process and further decide which content is added to the Google-Index and which content will be crawled more frequently.

Only webserver log files provide information about which and how often Googlebot crawls content. Because of this a continuous crawling monitoring should become the standard for every online venture. For this purpose crawlOPTIMIZER was developed, true to the motto: ‘Keep it as simple as possible’

SEO-Prozess

‘Google-Bot is Google’s web crawling bot (sometimes also called ‘spider’). Crawling is the process by which Googlebot discovers new and updated pages to be added to the Google Index.’ Source: Google Search Console

What's the purpose of crawlOPTIMIZER?

All measures are meant for increasing unpaid search engine traffic.

1. Google spends money for crawling

‘If you use google products our servers in our data processing centers do the work for you – worldwide and all the time. Our servers support many different products at the same time. This is the so called ‘Cloud’ Through always running our servers we are able to achieve more with less expense […]’, source: Google

 

• Google runs 15 data processing centers worldwide

• Operating costs per year are more than $10 billion dollars

• Google spends a lot of money for the crawling process of websites

• Your server resources are also heavy strained by an needless crawl volume

2. Use & added value

crawlOPTIMIZER offers insights on how Google crawls your website, thus which content Google is able to crawl and which one it isn’t. This information is necessary because without being crawled there is no ranking and thus no search engine traffic.

Examples:


• What does Google use its resources for and where are they wasted?
• Is my content being crawled?
• Which content is not being crawled?
• Does Googlebot have problems while crawling my website?
• Where is potential for optimization?
• and many more…

3. Goals of a crawling optimization

An almost full crawl of your whole website in a reasonable amount of time

✔ New and edited content should be added to the Google-Index as fast as possible

✔ Considerate & efficient use of your resources (server infrastructure, traffic etc.) as well as Google’s

✔ Locate errors of your own website i.e. infrastructure and fix them

✔ Strengthening of your brand

✔ Thus: increase of your visibility & traffic

 

Highlights

Why you need crawlOPTIMIZER

Googlebot activities

Get to know which pages are crawled by Google. Goal: decide upon measures that are improving the crawling process accordingly.

Complete analyses & evaluations

The dashboard represents the tool’s core with ready-to-use & relevant evaluations. Using it saves you a lot of precious time and money.

Data storage up to 5 years

Finally retroactive log file analyses can be done without effort! Thanks to log file storing in a save cloud. Easy access 24/7!

Simple & easy to understand

All predefines analyses & evaluations are prepared in an easy understandable way – even if you don’t have an SEO background.

Fast & easy connection

For the easiest way to access your log files, we have developed many options to choose from. The one-time setup is extremely easy to do.

24/7 support

If you have any questions we are always there to help. Also we are here to assist you with your initial setup. We are happy to be of service if you want us to talk to your IT or hosting provider.

Unique Features

crawlOPTIMIZER’s core pieces are the dashboard and the log file explorer.

Simple dashboard + KPIs

To make your work routine easier our dashboard contains complete evaluations based on your log files. Time consuming, manual log file analyses via Excel or ELK (Elasticsearch, Logstash, Kibana) are obsolete because of our dashboard where all important KPIs are predefined and made graphically available. All KPIs & evaluations are prepared in a way that even people without SEO background are able to understand them.


• Crawl budget statistics & waste of your crawl budget
• Status codes & crawling statistics
• Crawling of business relevant pages
• Top 50 of crawled URLs & resources
• Top 10 of crawled sitemaps & products
• Crawled types of content, parameters & http(s)
• Different googlebots
• And many more

Business-relevant measurements | crawlOPTIMIZER

The log file explorer

Everyone that tried to do log file analyses via Excel knows its related problems: bigger log files up to a million entries can’t be processed. Because of this you have only been able to analyze a snapshot of the googlebot. Our solution: crawlOPTIMIZER’s log file explorer.
Processing of nearly unlimited volumes of data

Because your log files are automatically stored and archived on our high-performance servers, you have easy access from everywhere all the time. Thus you are able to easily do long time & retroactive analyses.

Easy selection & filter possibilities

Our log file explorer offers you various filter options, so that you are able to do individual analyses & evaluations. Just a few clicks are needed to access needed data & information.

Logfile Explorer | crawlOPTIMIZER

Prices & packages

Extended until 30th November, 2018:
Special opening offers for the whole contract period

You need more than 500,000 requests per day or would you like to use the tool for your agency?
Then request an individual offer. Get in contact now!

STARTER

€ 149

monthly + VAT
Instead of € 249 monthly + VAT

save now 40%

Properties / websites:
1
Max. of Googlebot requests per day
75,000 / day
Log data saving
24 months
Minimum contract duration:
6 months
✔ Analyses dashboard
✔ Secure German server location
✔ Log file explorer
✔ Personal setup support
SEO Consulting:
-20% discount
Premium service WhatsApp support
PRO

€ 199

monthly + VAT
Instead of € 399 monthly + VAT

save now 50%

Properties / websites:
1
Max. of Googlebot requests per day
150,000 / day
Log data saving
24 months
Minimum contract duration:
3 months
✔ Analyses dashboard
✔ Secure German server location
✔ Log file explorer
✔ Personal setup support
SEO Consulting:
-20% discount
Premium service WhatsApp support
EXPERT Large

€ 299

monthly + VAT
Instead of € 599 monthly + VAT

save now 50%

Properties / websites:
1
Max. of Googlebot requests per day
300,000 / day
Log data saving
18 months
Minimum contract duration:
3 months
✔ Analyses dashboard
✔ Secure German server location
✔ Log file explorer
✔ Personal setup support
✔ SEO Consulting:
-20% discount
✔ Premium service WhatsApp support
EXPERT X-Large

€ 499

monthly + VAT
Instead of € 799 monthly + VAT

save now 38%

Properties / websites:
1
Max. of Googlebot requests per day
500,000 / day
Log data saving
12 months
Minimum contract duration:
3 months
✔ Analyses dashboard
✔ Secure German server location
✔ Log file explorer
✔ Personal setup support
✔ SEO Consulting:
-25% discount
✔ Premium service WhatsApp support

We only sell to entrepreneurs/companies
Above mentioned prices do not include VAT.
For further information feel free to contact us via email or phone +43 (1) 577 35 49.

Contact us

Need support or got questions? Get in touch!


I have read the privacy policy and hereby accept them by clicking the 'Send now' button.



Further ways to get in touch

XXXLUTZ
Baby Walz
Mömax
PLANET SPORTS
Möbelix
21run