Home

Sitemap Module

The Sitemap Module is an Expression Engine add-on that automatically generates a configurable sitemap of your website and notifies search engines about changes in your site. It is meant as an SEO tool for site administrators that use the Expression Engine content management system.

Support can be found in the comments and in this EE forum thread.

Download Sitemap
Current Version: 1.6.4 (released 2 April 2009)

* Works with ExpressionEngine 1.6 and higher.

Top

Concept

Sitemaps allow you to inform search engines about pages on your website that are available for crawling. A Sitemap is an XML file that lists URLs within your site, as well as additional information about each URL such as when it was last updated, how often its content changes and its priority within the site. The purpose of this is to help search engines to more intelligently crawl your website, with the ultimate aim of improving your pagerank.

Find out more about sitemaps at sitemaps.org

Top

How It Works

The Sitemap Module consists of two parts - a module and an extension. The module allows you to select which weblogs to include in the sitemap and to set preferences for each weblog - its change frequency, priority and template. You can also add URLs to the sitemap and set their preferences.

The purpose of the extension is that every time an entry on your site is created or changed using the PUBLISH and EDIT tabs, several search engines are notified that your site content has changed. A Sitemap tab appears that allows you to select whether or not to notify the search engines. It is selected by default if you are creating a new entry. The search engines that are currently supported are Google, Yahoo, Ask.com, Moreover.com (the MSN search index) and Live.com.

Screenshot

Screenshot

You can use the following variables in the uls which will be parsed accordingly:

{url_title}, {entry_id}, {weblog_id}, {cat_id}, {cat_name}, {cat_url_title}
	

* If an entry is assigned to multiple categories then only the first category will be used in parsing

If your sitemaps are very large then you can define the start index and limit of the number of entries shown (Google's limit is 50,000). For example:

{exp:sitemap:get start="0" limit="10000"}
	

You can also define the start index and the limit in the url in the following way (since version 1.6.1, requires curl):

http://www.mysite.com/sitemap.php?start=0&limit=50000

http://www.mysite.com/sitemap.php?start=50000&limit=100000

http://www.mysite.com/sitemap.php?start=100000&limit=150000
	

This allows you to submit multiple sitemaps to Google and to use sitemap index files to group multiple sitemap files. Please ensure that you have version 1.6.1 of the module or later installed and that you have updated the sitemap.php file.

Top

Installation

Download and unzip sitemap.zip, then follow the steps below:

  1. Upload the sitemap folder to the system/modules folder
  2. Upload lang.sitemap.php to the system/language/english folder
  3. Upload ext.sitemap_pinger.php to the system/extensions folder
  4. Create a template called sitemap and place the following line it: {exp:sitemap:get}
  5. Upload sitemap.php to the root directory of your website and change the template variable in it
  6. Install the Sitemap module (Control Panel -> Modules -> Install)
  7. Enable the Sitemap_pinger extension (Control Panel -> Admin -> Utilities -> Extensions Manager -> Enable)
  8. Set the sitemap preferences (Control Panel -> Modules -> Sitemap)
  9. Use the links to submit your sitemap manually to Google and Yahoo
Top

Updates

When updates become available, you can easily update the module and extension for free by downloading and then uploading the new files to the appropriate directory. Once you have uploaded the files, just go into the Sitemap Module from the control panel and the module will be automatically updated. Go into the extensions page and the extension will be automatically updated.

* This module will be updated for EE 2.0 once available for free

Top

Download

Each individual license costs $39.95, which allows you to use the module on one installation of EE. You must purchase a license in order to download the Sitemap Module. Once you have completed payment you will be sent a code that will allow you to download the file.

By purchasing the Sitemap Module you agree to the license agreement.

If you have already purchased the Sitemap Module then you can download it by entering your email and code below.

Email:
Code:
Top

License

By purchasing the Sitemap Module you agree to the following conditions:

  • One license grants the right to perform one installation of the Sitemap Module. Each additional installation requires an additional purchased license.
  • You may not reproduce, distribute, sell or transfer the Sitemap Module, or portions thereof, to any third party.
  • All copyright and proprietary notices within the Sitemap Module files must remain intact and unaltered.
  • The Sitemap Module is provided "as is", without warranty of any kind.
  • You assume all risk associated with the installation and use of the Sitemap Module.
Top

Changelog

Version 1.6.4

  • Fixed a bug caused by last update in which entries were shown multiple times if they were assigned to multiple categories

Version 1.6.3

  • Added limit field to sql query
  • Fixed update weblogs bug caused by last update

Version 1.6.2

  • Added ability to change settings for site index page
  • Added link to show/hide excluded locations and weblogs (thanks to Todd for the suggestion)

Version 1.6.1

  • Added option for start and limit parameters to urls

Version 1.6

  • Added variable parsing

Version 1.5

  • Added start and limit parameters to allow for multiple sitemaps
  • Added functionality to prevent expired entries from appearing in sitemap
  • Optimised sql queries and reduced php memory requirements

Version 1.4.2

  • Fixed a bug that was causing problems when checking for updates

Version 1.4.1

  • Performs checks on the edit date to ensure lastmod is formatted correctly and fixes bad dates

Version 1.4

  • Replaced template dropdown box with url input box
  • Locations are now specific to individual sites (MSM compatible)
  • Added confirmation box when deleting locations
  • Sitemap pinger now ignores weblogs that are excluded from the sitemap
  • Fixed a bug that was creating the link to the rendered sitemap with a missing slash
  • Fixed a bug that was causing problems on some servers when installing the module

Version 1.3

  • More template options added to template selection list
  • Changed naming of status options for clarity
  • Added a check to prevent sessions from being started more than once
  • Fixed a bug that was causing the tab body of other extensions to be overridden
  • Fixed a bug that was causing the first template of each group to not appear in template selection list

Version 1.2

  • Fixed a bug that was causing double slashes to be added after site url in some cases
  • Fixed a bug that was causing tabs put on the publish page by other extensions to be overridden (thanks to Leevi Graham)

Version 1.1

  • Sitemap tab added to the publish and edit pages in the control panel, allowing you to select whether or not to send a sitemap ping to search engines
  • Template group names added to template selection list (thanks to Victor Gutierrez for the suggestion)
  • Fixed a bug in the extension that was causing errors when entries were being submitted from stand-alone entry forms

Comments

Blank Avatar
harry
05 November 2007


Module works perfectly! Very clean interface. Thanks for this!

Blank Avatar
Rick
05 November 2007


Excellent module! Very well thought out and designed. Also very clean and simple to use. I had it up and running within 15 minutes and google is now showing 99 urls mapped versus the 17 it was previously! It is also nice to know that it is always notifying the search engines when I make changes. I don't have to do a thing anymore.

Thank you for sitemap! It has saved me a ton of time.

Blank Avatar
Shawn
13 November 2007


The module is a snap to install. In 10 minutes, it's up and running and outputting beautifully. I couldn't have asked for a better module.

I can't tell you ho much time you've saved me with this module.

Thanks a million.

Blank Avatar
Ben
14 November 2007


Version 1.1 is now available and has some new little features, but more importantly it addresses a problem that version 1.0 had with stand-alone weblog entry forms.

Blank Avatar
Roman
21 November 2007


hi,
fantastic application - just what i've been waiting for!!!
as i run a news site which is listed in google news it would be great if i could limit the entries to the last 3 days cause this it what google news wants me to do...
piniging google doesn't work for me and if i click on "View Google's index of your website" i get all pages listed in google - not just my pages...
nevertheless some fantastic job you did!
thanks' again
cheers
roman/berlin/germany www.berlinista.com

Blank Avatar
Ben
22 November 2007


hi roman,
i had a look at your sitemap and the locations don't seem to have your website base url in them, i'm guessing that that's why pinging google doesn't work. what build of EE do you have installed?

Blank Avatar
Roman
22 November 2007


hi,
Build: 20070622
actually i don't know how to get the url into the sitemap.
thanks'
roman

Blank Avatar
Ben
23 November 2007


roman, the url is automatically pulled in using the $FNS->fetch_site_index() function. from your control panel go to Admin -> System Preferences -> General Configuration and check if the "URL to the root directory of your site" is set.

Blank Avatar
Roman
02 December 2007


hi,
this works!!!
thanks' a ton. somebody built my site and obviously didn't do everything right. after receiving all the money he now refuses to help and i'm lost.
thanks' again!

Blank Avatar
Ben
02 December 2007


no problem, glad that worked.

Blank Avatar
mark
04 December 2007


Hi,

Great idea for this module! I have a question regarding sitemaps urls and EE's pages module urls though. The sitemap urls being created include /pages/page_name (the template name) even though the url I am specifying is /project/page_name as seen below:

sitemap module creates:
http://www.1111camino.com/dev/index.php?/pages/the_condos

while the EE display url is:
http://www.1111camino.com/dev/index.php?/project/condos

Is this in essence looking like duplicate content to the SE's?

Any comments appreciated!
Thanks,
Mark

Blank Avatar
Ben
04 December 2007


hi mark, the EE display url, http://www.1111camino.com/dev/index.php?/project/condos, is that url using the pages module? if it is then you could set the status of that weblog to closed and specify it as a url in the sitemap.

if you can post the url to your sitemap here, or email it to me then i could take a closer look.

Blank Avatar
mark
05 December 2007


Hi Ben,
Yes http://www.1111camino.com/dev/index.php?/project/condos is the URL I have assigned to that entry in the pages module. I am a bit confused when you say to close the weblog (which I have named "pages" also) and specify it as a url in the sitemap. If I close the weblog....it no longer is live and doesn't display at all in the sitemap.

http://www.1111camino.com/dev/index.php?/site/sitemap is the url to the current sitemap.

I'm new to EE and very light on coding so if my questions seems odd...that's why :)

Thanks Ben!
Mark

Blank Avatar
Ben
05 December 2007


from the sitemap module screen you can set the status of each weblog to open or closed. selecting closed does NOT close the weblog, but simple means that it is not included in the sitemap.

if you do this, you can then press the big green "insert new location" button in the top right, and add the url's that you use with the pages module manually.

i hope thats clear enough

Blank Avatar
mark
05 December 2007


Hi Ben,
Excellent! Thanks for that clarification. Its working great now!

Mark

Blank Avatar
Chuck
14 December 2007


I'm puting up site in a couple of weeks and am very interested in using your Sitemap Module. My question is does it ping the search engines from a stand alone entry form?

Blank Avatar
Ben
14 December 2007


hi chuck, yes it does ping search engines on submission of a stand alone entry form.

Blank Avatar
Kevin Goeminne
23 December 2007


Hi,

I just purchased the module it worked fine in my offline copy. But when i try to view the renderd map it seems to fails.
I think i set up everything correct you can fine the sitemap here : http://www.geboortelijst.be/sitemap.php you will see it keeps loading.

But the template is correct http://www.geboortelijst.be/index.php/sitemap and gives a result. Can you give me any hints on whats going wrong i cant wait to see the results of implementing these site maps.

Kevin,

Blank Avatar
Ben
26 December 2007


hi kevin, try removing any spaces or blank lines before the exp:sitemap tag. if that doesn't solve it then it may be a redirect problem. test it with some sample text and let me know if that helps.

Blank Avatar
kevin
26 December 2007


Hi ben,

Nope removing the tag or placing other text in it has the same effect it seems to be loading forever.

Is there something else i can try? Would it not be easyer to just include the template?

Blank Avatar
Phil
02 January 2008


Having troubles getting the module to work. Are there known issues if you are using an .htaccess file to remove the index.php from the EE URL?

Oh, wait...the problem was I have the site offline. The sitemap.php doesn't play nice with the System Offline template.

A different problem though is I cannot select the template I need. The templates are not showing up correctly in the template drop down on the Sitemap CP.

Blank Avatar
Quena
03 January 2008


Anybody else experiencing double slashes ("//") in the sitemap URL s, between the domain name and the first segment? Except for my site's root and the manual locations, all of the sitemap's URLs look like

http://example.com//article/1/

A suggestion, to remove the trailing slash from my {path}, did not work (click my name).

I am running EE 1.6.0 and am using the exclude method to remove index.php from the URL.

Blank Avatar
Ben
04 January 2008


Kevin: the template is included, it is called sitemap_template.txt

Phil: can you please elaborate a bit on what happens when you click on the template drop-down.

Quena: i have emailed you with the solution. i will be posting an update shortly that fixes this problem.

Blank Avatar
Quena
04 January 2008


Works like a charm!

Blank Avatar
Sufian
07 January 2008


Hi,
I purchased the lic on 12/31/07 however I never got a code. Where can I download the files?

Blank Avatar
Ben
08 January 2008


Sufian: the code was sent to you, but blocked by your spam filter. i have sent it again.

Blank Avatar
Russ
09 January 2008


My template keeps putting in the // and I have removed the back slash from root, any ideas?

Blank Avatar
stefan
10 January 2008


Hi Ben,

can I see a demo of your Module? I'm interessted in the layout and the ability to style via CSS.

cheers

Blank Avatar
Ben
10 January 2008


Russ: version 1.2 contains a fix for this.

stefan: i think you may have missed the point of the module. it creates an xml sitemap (also known as a google sitemap) of your entire site. there is no layout or styling. hope this clarifies things.

Blank Avatar
Sufian
11 January 2008


Ben, I checked my spam settings and still have not seen any emails re the code. I just sent an email via another email account. Please send to that one.

Blank Avatar
Leevi Graham
20 January 2008


Ben: I think there could be an issue with SiteMap Pinger and LG Better Meta. It seems that your tab is overriding any other tabs.

You may need to check for previous new tabs.

Cheers

Blank Avatar
Ben
21 January 2008


hi leevi, thanks for letting me know about that, i have added the fix to the current release. cheers, ben

Blank Avatar
current
22 January 2008


Hi Ben,
i purchased sitemap but have experienced an issue when trying to view the rendered sitemap template:

Parse error: syntax error, unexpected T_STRING in /../system/core/core.functions.php(637) : eval()'d code on line 1

What happened here?

Blank Avatar
Alex
06 February 2008


Working like a charm! Thank you! But I’ve got two questions. Can I use this module for my wiki’s articles? And what exactly is “Insert new location” button? For what reason should I use it?

Blank Avatar
Ben
06 February 2008


hi alex, i have not tried using it with the wiki module, but i assume not since the sitemap module reads entries from the weblog entries table.

the “Insert new location” button lets you insert additional urls into the sitemap. for example, if part of your site is external to EE then you could manually add the urls to it. or if you have a template that you want to include in the sitemap that doesn't have any associated weblog entries then you could add its url too.

Blank Avatar
Alex
07 February 2008


Well… Everything was OK, but I’ve got a strange problem starting this morning. I tried to add url using site modem, but when I’m trying to access it in admin/modems panel all I’ve got is a blank page. Looks like modem itself is working, ‘cause I see its result in publish page and Goggle can access my map without problem. But I cannot configure modem any more. Using it in admin/modules leading to blank page only. I reinstalled everything using fresh downloaded files, but still can not see configuration panel of modem. Please, help.

Blank Avatar
Alex
07 February 2008


Suddenly everything is back to normal. I believe this glitch is somehow connected to the Goggle itself. ‘Cause everything was fixed as soon as I resubmitted my sitemap in Goggle.

Blank Avatar
Ben
07 February 2008


ok, glad you got it sorted

Blank Avatar
Brendon Carr
09 February 2008


I have a feature request: Notifications of updated sitemap to Google, Yahoo et al only in the case of content being placed in a certain status specified by the user -- for example, "Open". For those of us who have a draft-in-progress workflow, immediate notification of so-called "updates" is premature and could result in bots trying to index content that is not ready yet. Don't they penalize when they visit and can't find the content?

Blank Avatar
Rushing
12 February 2008


Has anyone used this on MediaTemple GS?

Blank Avatar
Roman
13 February 2008


Hi Rushing, i've been on MT GS (till last week) and it worked perfectly.
To all: after moving my webspace and updating the module to 1.2 i now get this: error on line 1 at column 47: Space required after the Public Identifier
Where exactly do i have to add space? using the standard file which came with the update.
Sorry for being too much of a noob...

Blank Avatar
Kevin
17 February 2008


Hi,

I'am having issue with the curl this works fine when i try to call any websiite outside my server. But when i try to call a link that is on the same server it does not work.

How can i fix this? I bought this module a month ago and still was not able to use it.

I hope to have an anwser fast thanks in advance,

Blank Avatar
Ben
17 February 2008


kevin, can you please explain what the problem is? its unclear to me.

Blank Avatar
Matt Johnson
18 February 2008


Hey Ben,

Could you take a look at this thread please.

Thanks

Blank Avatar
Ben
18 February 2008


roman, it seems it was a memory issue with your service provider, see this thread

matt, i am working on this and will have an update for you shortly

Blank Avatar
Ben
18 February 2008


matt: version 1.3 contains a fix for this

brendon: this is already possible with the status options (new naming convention in 1.3 for clarity)

Blank Avatar
Roman
22 February 2008


Hi,
is there any chance that you might offer some feature which lets me add more sitemaps that get updated whenever i post a new article? I have two other sitemaps - one for google news international and one for the german google news which i'd have to update using a cron job. being able to add those to the module would be the far more elegant solution :-)
just asking...

Blank Avatar
Jon Robinson
22 February 2008


nice, thanks!

Blank Avatar
Street Trees
28 February 2008


Great tool. Looks like it will be a big help to those who use Google Webmaster Tools.

Blank Avatar
Dion
28 February 2008


Dear Ben,
Some 'lastmod' tags seem to be rendering the following dates: 2005--1-1-
While other render fine: 2007-11-06
Google doesn't like those dates and classifies them as unknown dates/renders as an error.
Any idea what causes these lastmod tags to be rendered like this?
Thanks.

Blank Avatar
Mark Fleming
28 February 2008


I own 1.2. How do I download the 1.3 update?

Blank Avatar
Ben
29 February 2008


dion: i don't know why this might be happening, but i'll investigate. can you email me the link to your sitemap please.

mark: just enter your email and code into the download form on this page and you will get the latest files. upload them to your server and you're done. you can also see the update changes in the changelog.

Blank Avatar
Mark Fleming
01 March 2008


Upgraded to 1.3 and I get this:

XML Parsing Error: no element found
Location: http://www.homerobots.com/sitemap.php
Line Number 1, Column 2:

By the time you look at it I might be back to 1.2.

Blank Avatar
Mark Fleming
01 March 2008


Never mind, sorry. We did something wrong on our end.

Blank Avatar
Robert Scanlon
07 March 2008


I'm getting this error after reinstalling my entire site (it worked fine before - great module, Google loved it, but we had a server crash and I've just rebuilt everything) - the last thing to do was install the sitemap module. I've tried a few variations of settings. Any clues?

XML Parsing Error: syntax error
Location: http://www.hotyogadoctor.com/sitemap.php
Line Number 1, Column 50:
-------------------------------------------------^

Thanks!

Robert

PS. Sitemap is at http://www.hotyogadoctor.com/sitemap.php

Blank Avatar
Robert Scanlon
07 March 2008


If I view the rendered template at:

http://www.hotyogadoctor.com/index.php/site/sitemap/

I get the sitemap!

So what is the issue - why doesn't sitemap.php render that for me? What have I done wrong!

Cheers,

Robert

Blank Avatar
Robert Scanlon
07 March 2008


OK I think I have it now - despite full propagation, I'm still showing some files at another host (temp while we fixed our crash). It appears sitemap.php is trying to go via the old dns - I have no idea why, as the domain is removed from that site and everything else is fine, hopefully it is a short term issue.

Cheers,

Robert

Blank Avatar
Ben
08 March 2008


hi robert, it seems to be working now.

i'm currently at SXSW and just met the ellislab team and some EE member communities!

Blank Avatar
Robert Scanlon
08 March 2008


Hi Ben - that sounds exciting!

Tnx for checking, appreciated. It did take a little while, but resolved itself. It's a great app, thanks (Especially if your server goes down with no backup and you need to tell Google where to go to find all your pages again).

It was a weird propagation issue, despite a full 2 days and everything working fine, that particular url was trying to resolve at the temp host despite the fact that it (that filename) had never been hosted there.

Any gossip on EE2.0 at SXSW?

Blank Avatar
gregg
10 March 2008


I'm having two issues with sitemap on my site.

1.) I cannot enabled the extension site pinger. I click enabled extensions but it never turns it on.

2.) The urls logged into the sitemap are not the full url's..
i.e. /blog_entry_name

when it should be
i.e. /reviews/detail/blog_entry_name

Blank Avatar
Sharif
17 March 2008


Hey Ben,

I'm still having trouble with the installation, and posted details and error messages in this thread. (I also sent you a PM with a little more info.)

Any advice would be most appreciated...

Blank Avatar
Gregg
17 March 2008


Ben,
I have been unable to get any support on your component? Can you please drop me an e-mail on how to get my extension fixed as well as how to get the sitemap.php working when .htaccess is setup to remove the index.php?

Blank Avatar
Gregg
17 March 2008


A follow up on my two issues which I have found resolutions for:

1.) If you can't enabled the sitemap pinger extensions, check to make sure your path.php and config.php are set to 666. I believe this was the source of the issue.

2.) If you are using the .htaccess method to remove index.php, you will need to do add the following to allow sitemap.php to be picked up on your site.

RewriteRule ^sitemap.php$ /index.php/site/sitemap_name/ [L]

This is a great module, however I have waited at least a week to get some help from Ben with no luck. I can understand this if this product were free, but when your charging you should have a better support system in place to help out the paying customers.

Blank Avatar
Ben
17 March 2008


hi gregg, i apologise that this issue took a while to resolve. unfortunately it coincided with me being abroad, but also as it turned out it was not a problem with the sitemap extension.

anyway, i hope you are satisfied with the module and again sorry for the inconvenience.

Blank Avatar
Shelomo
27 March 2008


I've been trying to get thi up and running but i still get the home page coming up when i hit http://www.weisslurie.com/sitemap.php the site map does show up at http://www.weisslurie.com/site/sitemap

Im using the htaccess to remove index.php and i tryied the above code
RewriteRule ^sitemap.php$ /index.php/site/sitemap_name/ [L] whicj didnt seem to work

Blank Avatar
Shelomo
27 March 2008


Well after finding this code on the EE forums i got it to work

RewriteRule ^sitemap.php$ /index.php/site/sitemap/ [L]

RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule ^(.*)$ index.php?$1 [L]

Blank Avatar
jasmanac
04 April 2008


I don't see Sitemap tab when I want to publish something?

Blank Avatar
Ben
05 April 2008


Is the sitemap pinger extension enabled?

Blank Avatar
jasmanac
07 April 2008


Sorry I didn't notice that pinger extension is not enabled.

Blank Avatar
Deepvision
16 April 2008


Hi,

I want two types of sitemap, an XML one for the search and a visible one for site visitors. This may be a stupid question, but can the module create both?

Thanks.

Blank Avatar
Ben
16 April 2008


this module creates an xml sitemap only. i would think if you wanted to create a sitemap for visitors that it would have to be styled, plus you would probably want to have more control over the content


Maybe I'm stupid, but I can't get it to work.
I get the following error:

'This page contains the following errors:
error on line 1 at column 1: Document is empty
Below is a rendering of the page up to the first error.'

Besides that I cannot insert a New Location?

Any help appreciated.

Blank Avatar
Ben
03 May 2008


guus, please post the link so i can check the error message.

the New Location issue is now fixed so please download latest version

Blank Avatar
Guus
03 May 2008


Hi Ben,

Thanks for your quick reply!

It seemed that I didn’t correctly changes the template variable in the sitemap.php
I downloaded a new version, so the New Location function is now working!

The only thing I don’t understand is where the sitemap.xml is generated?

Regards,

Guus

Blank Avatar
Ben
03 May 2008


no problem, glad you got it working

ah, that is where the magic happens. if you look near the top of the sitemap.php file then you will see that the content type is set to xml, and the xml code is then generated by the module.

cheers,
ben

Blank Avatar
Guus
03 May 2008


Yes, I saw that but I must have an .xml file to submit my sitemap manually to Google and Yahoo!?

Where is the sitemap.xml?

Blank Avatar
Ben
03 May 2008


you should submit the url of your sitemap.php file, they will read it as an xml file

Blank Avatar
Guus
03 May 2008


Aha, now I understand!

Thanks Ben

Blank Avatar
Dave
05 May 2008


Hi,

I'm having trouble when installing the module via the Modules tab.

The error I'm getting is:
MySQL ERROR:

Error Number: 1074

Description: Too big column length for column 'url' (max = 255). Use BLOB instead

Query: CREATE TABLE IF NOT EXISTS `exp_sitemap` ( `id` INT(6) UNSIGNED NOT NULL AUTO_INCREMENT, `weblog_id` VARCHAR(10) NOT NULL, `url` VARCHAR(300) NOT NULL, `site_id` VARCHAR(10) NOT NULL, `status` VARCHAR(10) NOT NULL, `change_frequency` VARCHAR(10) NOT NULL, `priority` VARCHAR(10) NOT NULL, PRIMARY KEY (`id`));

Can you help?

Blank Avatar
Ben
05 May 2008


it looks like your database is limited to 255 characters for a varchar field. i have added a fix to the module, please re-upload the new files and try again

Blank Avatar
Dave
05 May 2008


Works like a charm. Thanks Ben.

Very impressed with the speed of reply too.

Blank Avatar
Dave
05 May 2008


I also had to come back and say I think this module is great. Not just because it meets a need superbly, but also because the attention to detail of things such as the links to Google and Yahoo sitemap submission pages makes me feel you must have done a good job with the bits I'm never going to look at.

Well done.

Blank Avatar
Ben
05 May 2008


thanks dave, i appreciate the compliment

Blank Avatar
James
08 May 2008


Is there any way to make "Send sitemap ping to search engines" check box checked by default when editing an entry. I have a situation where this is desired.

Blank Avatar
Ben
08 May 2008


hi james, this cannot be done but i will add it as an option in the next release.

in the meantime you can make it work by changing line 248 in ext.sitemap_pinger.php from:

if($IN->GBL('C', 'GET') == 'publish')

to:

if(1)

Blank Avatar
James
08 May 2008


Ah ok....

I noticed a few problems in my output. Some of the dates being returned are kinda strange. I have some dates like this:
1225-42-56
1228-97-16
1233-81-00
1224-82-08
etc...

This is obviously throwing up some warnings with Google. Any ideas?

Going in and editing the post and saving it does fix the problem. But it is kinda annoying.

Blank Avatar
Ben
12 May 2008


the latest version checks and fixes bad dates

Blank Avatar
Simon
12 May 2008


Hi,

I've bought the module and love it. I think I’m missing something obvious though so please excuse me if the question is obvious.

Google needs the sitemap to be created at the root directory but the only module related file I can see there is the sitemap.php file (which returns an error when visited www.alchemea.com/sitemap.php), not that Google seems to accept .php files as sitemaps anyway.

I do have an xml page but this is at: http://www.alchemea.com/index.php/global/xmlsitemap. How can I get this to the root directory?

Thanks

Blank Avatar
James
12 May 2008


Google will accept "www.alchemea.com/sitemap.php" as a valid sitemap feed.

Have you enabled the module and extension?

In your template /global/xmlsitemap do you only have the following: {exp:sitemap:get}

Have you modified the template variable in sitemap.php to point to that template (/global/xmlsitemap)?

Blank Avatar
Simon
13 May 2008


Hi James,

This is clearly the day of me missing the beeding obvious. The template variable was incorrect and all now works fine.

Thank you.

Blank Avatar
Simon
13 May 2008


Hi James,

This is clearly the day of me missing the beeding obvious. The template variable was incorrect and all now works fine.

Thank you.

Blank Avatar
Simon
13 May 2008


Hi James,

This is clearly the day of me missing the beeding obvious. The template variable was incorrect and all now works fine.

Thank you.

Blank Avatar
BenB
16 May 2008


Hi Ben, looking at the code I take it that slashes are supposed to be added to the end of entry title urls (for example)? For some reason this is not happening on our sitemap: http://www.cafedelabourse.com/sitemap.php
Does any setting in Expression Engine affect that?
thanks, Ben.

Blank Avatar
Ben
16 May 2008


actually no... slashes aren't added to the end of the title urls. i really don't think it makes a difference to any web browsers or google though. or do you need it for some other reason??

Blank Avatar
BenB
16 May 2008


Just for SEO purposes, so the urls are the same everywhere.

Blank Avatar
Laurent C
18 May 2008


Hi Ben,

I just installed your sitemap module. It works great.

Do you plan on adding the ability to include wiki articles and forum entries, too?

That would be fantastic ...

Blank Avatar
Ben
18 May 2008


BenB: if you really want a slash at the end then you can change line 122 in mod.sitemap.php to:
$location = $url.$entry['url_title']."/";

Laurent: i will definitely consider it for a future release, though right now i can't say exactly when that might be...

Blank Avatar
Matt
02 June 2008


Hi Ben,

I am getting this error at the top of my sitemap module page in the cp:

Notice: Undefined offset: 1 in /home/green/webapps/htdocs/admin/modules/sitemap/mcp.sitemap.php on line 464

When I try to look at the sitemap ( http://www.greenmarketing.com/sitemap.php ) I get the following error:

XML Parsing Error: no element found
Location: http://www.greenmarketing.com/sitemap.php
Line Number 1, Column 2:
-^

Strange think is, it was working fine, then my host's (webfaction) data center had a fire and everything closed down for a day and a half. Everything is back-up but my queries to my database are very slow. I am not sure if that has some how screwed things up.

Would be glad of some help.

Cheers,
Matt

Blank Avatar
Matt
03 June 2008


I think it may be fixed. I have a feeling it was all due to a network issue and the problems at the data center.

By the way, this is a great module. Thank you!

Matt

Blank Avatar
Ben
03 June 2008


cool, thats good to hear.

thanks, i enjoy working on it!

Blank Avatar
alex
05 June 2008


paid but where is the "code"?

Blank Avatar
Ben
05 June 2008


sometimes takes a bit of time for the payment notification to come through but you should have it by now

Blank Avatar
alex
05 June 2008


Am I looking for a notification from you of paypal?

Blank Avatar
Ben
05 June 2008


alex, the code was sent to your email. i'll resend now, but please check your spam folder in case it was accidentally put there

Blank Avatar
Ken
06 June 2008


Works like a dream, thank you!

Blank Avatar
DJ
18 June 2008


Ben,

Great plugin. However, I need your help to get it working properly. I have installed it fine, created a sitemap template, set the right template path in sitemap.php, and removed index.php from the file path since I use .htaccess. I use the 'exclude method' so I added sitemap.php to make sure I can access it. No dice.

I get:

"This page contains the following errors:

error on line 1 at column 1: Extra content at the end of the document
Below is a rendering of the page up to the first error."

Any help appreciated.



Blank Avatar
Ben
18 June 2008


hi DJ, please ensure there are no blank lines or any other text before or after the {exp:sitemap:get} tag in your template. if that doesn't help then view the source code of the rendered page and check if the xml text is appearing there.

Blank Avatar
DJ
19 June 2008


No space before or after in the template.

There is no source code on the error page at all – not even for the error message (Safari). In Firefox all I get is a blank page.

I'm thinking this is related to my .htaccess set-up, yet I've included the sitemap.php and removed index.php from the path.

Any other suggestions?

Blank Avatar
Ben
19 June 2008


can you show me the appropriate line in your .htaccess file please. it should look something like this:

RewriteCond $1 !^(images|system|themes|index\.php|sitemap\.php) [NC]

Blank Avatar
DJ
20 June 2008


RewriteCond $1 !^(images|name-of-my-system-folder|themes|index\.php|img|css|js|client|favicon.ico|exclude.html|sitemap\.php) [NC]

Blank Avatar
Ben
20 June 2008


that looks right. can you look at your sitemap template url, so for example www.my-site.com/site/sitemap, and check if it shows up correctly there. if it does, then make sure that the $template and $sitemap_url variables are correctly set in sitemap.php

if you still can't solve it then send me an email and i can help you troubleshoot further.

Blank Avatar
DJ
21 June 2008


Fixed it, there were a couple things:

1) I was using the Pages module and had a template called sitemap in the root. I added your sitemap template to it's own template group.

2) I was missing '/' in the $sitemap_url

3) When you copy and paste paths from the forum, it uses curly quotes.

Thanks for you help, this is a kickass module.

Blank Avatar
Ste
03 July 2008


Hi Ben,

I've just purchased the sitemap module but after playing about with it, am I right that it doesn't dynamically generate links for pages in EE's static pages module? I have 85 static pages on my site and don't want to be adding them all manually via the Insert New Location button; not to mention that I don't want to have to manually maintain the static pages within the module if any of our multiple users add, remove or edit any of the pages.

Thanks for any advice,

Ste

Blank Avatar
Ste
03 July 2008


Hi Ben,

I've just went through the EE thread and unfortunately, it looks like the module doesn't support EE's static pages module - you said in March 2008 that it's something you'd like to work on, have you got any sort of timeline for this at all?

I also have another question - I have a weblog (news) that has a template group (news), but within this group, as well the the main group for news stories (news/index), I also have other templates for other categories of news item (news/press-releases, news-case-studies, etc).

I have figured out how to display the main news stories, but how can I also display the news/press-releases entries?

The same issue also happens in my people weblog - I have a template group named 'about,' but besides about/index, I also have about/staff, about/trustees, about/partners, about/supporters, etc, and each template displays the content in different ways but so having the entire weblog open in news/index just doesn't work right for me.

I know I can add the URL's manually, but I'm talking about hundreds of entries here.

Again, any advice would be appreciate if I'm missing something here.

Thanks,

Ste

Blank Avatar
Ben
04 July 2008


hi ste,

the pages module is indeed the priority for the next major release, and i realise it was in march when i mentioned it but unfortunately other projects have delayed its release. so i'm afraid i can't say when it will be available, but it definitely will become a feature of the module.

regarding your news and people weblogs, because of the complex way in which weblog entries can be displayed, in your case it appears to be by specifying categories, the module can currently only be used to display one template for each weblog. this is because people use the weblogs in many ways. for example on a specific template you may only display weblog entries that are in a specific category or have a certain status. the module doesn't support all of these ways of displaying content unfortunately.

if you think that the module is not suitable for your particular site and would prefer not to use it then i would be happy to refund you. please email me if this is the case.

all the best,
ben

Blank Avatar
Bill
08 July 2008


Hi Ben,
I am excited about this module! However I am getting the following error When I try and "View Rendered Sitemap", however I can view the site map at its URL.

The following tag has a syntax error:
{exp:lg_polls:poll}
Please correct the syntax in your template.

Is this a conflict with the actual module, or a novices user error?

Thanks for your insight,
Bill

Blank Avatar
Ben
09 July 2008


hi bill, clicking on "View Rendered Sitemap" should take you to the url, which you say is working... so i'm confused.

the site/sitemap template should only have one line in it:

{exp:sitemap:get}

let me know if this helps

Blank Avatar
Kim
11 July 2008


Hi,

I have just tried to uninstall Sitemap, but when I do I get the following error when submitting a new post in the publish page. When I reinstall Sitemap the problem goes away, but returns again if uninstalled:

MySQL ERROR:

Error Number: 1146

Description: Table ‘user_ee.exp_sitemap’ doesn’t exist

Query: SELECT status FROM exp_sitemap WHERE weblog_id = ‘1’

Blank Avatar
Kim
11 July 2008


Problem solved - I needed to disable the sitemap pinger in the extensions manager

cheers

Kim

Blank Avatar
Leslie Morgan
12 July 2008


Hi, I just purchased the module but didn't get the email. I checked all my spam folders, etc. Is there something I can do?

Blank Avatar
Ben
12 July 2008


hi leslie, i've resent it to you

Blank Avatar
Boyink
22 July 2008


Hey Ben -
I just installed the module and got it working in pretty short order. The only hitch I ran into was on my site I've not removed index.php, I've renamed it.

This caused an error when trying to load the rendered sitemap due to the hardcoded "index.php" in sitemap.php. Changing that reference to my renamed index.php name got me up and running -- but it would be nice if the value was pulled dynamically from Admin > System Preferences > General Configuration > Name of your site's index page.

Blank Avatar
Ben
29 July 2008


i don't think that many people rename their index.php file to something else. most either keep it or use their .htaccess file to hide it from the url.

thanks for the suggestion though!!

Blank Avatar
Courtney
31 July 2008


Hi, I'm having a hard time getting Google to recognize this as a valid sitemap. Please forgive my naivete, but am I supposed to give Google the address to the sitemap with the .php extension as added to the root folder or as a .xml extension? Does this module automatically create a .xml file? Thanks.

Blank Avatar
Ben
31 July 2008


yes, you give google the url to the sitemap.php file, for example:

http://www.mysite.com/sitemap.php

the headers in the php file make it appear to be an xml file, which google can recognise and read

Blank Avatar
triom
02 August 2008


Hello Ben,

I purchased this plugin a couple months ago and it's great! I'd like to also say that it would be wonderful if the sitemap covered the wiki as well. What are your future plans with the sitemap module?

Best,
triom

Blank Avatar
Roman
15 August 2008


Hi,
need to dive into the code in a minute. Looking for the place where i can add the "article id", as every of our urls has an at least three digits number, because of google news. Your module doesn't show the article id in the url so webmaster tools gives me "duplicate entries" warnings all the time. I'll find the place where to add the "id" but it never the less would be nice if you could hint me at the exact location.
If i may add a wish: please add some fields where one can add a blog of his choice and the option to choose the "status". We use four statusses: open, closed, feature and draft. The "open" articles get picked up by your module, but not our "feature" articles cause i think your module only looks for "open" articles.
Thanks'

Blank Avatar
triom
15 August 2008


Thanks for the great module! I have installed it and run into an issue... my template group is 'site' (the default for EE) and I'm using the 'include' method for removing index.php from the URLs.

This is what is in my .htaccess file:
RewriteEngine on
RewriteCond $1 ^(weblog|member|search|forums|site|P[0-9]{2,8}) [NC]
RewriteRule ^(.*)$ /index.php/$1 [L]

Because 'site' is in the .htaccess file, the sitemap.php file isn't able to be accessed properly. One fix is to rename sitemap.php to something else or to change the template group from 'site' to something else.

A preferred fix would be to edit the .htaccess to account for sitemap.php. Do you know what the .htaccess file should look like? Are you running into the same issue? I imagine this is pretty common because the default template group is called 'site' and using the 'include' method to remove index.php is also common.

Thanks for your help!

Blank Avatar
triom
19 August 2008


I've gotten it to work! Here's what my .htaccess file looks like now (I added the bottom line):

RewriteEngine on
RewriteCond $1 ^(weblog|member|search|site|P[0-9]{2,8}) [NC]
RewriteRule ^(.*)$ /index.php/$1
RewriteRule ^/index.php/sitemap.php$ sitemap.php

Blank Avatar
Danny Tam
28 August 2008


Hello,

I've recently moved halfway across the world - and unfortunately did not bring my desktop with me. Getting back into ExpressionEngine and would finally love to install your module - meant to before I moved, but settling work and school took a while!

When you get this, please kindly send the code to the email address provided with this comment - it should be the payment email address I used as well.

Thanks again for the huge help!

Danny

Blank Avatar
Ben
28 August 2008


hi danny, i resent it to you.

all the best in settling in!

Blank Avatar
Gerard
04 September 2008


Hello Ben,

I purchased the sitemap-module this afternoon, but didn't receive a confirmation e-mail with the code to download the module.
Could you please (re-)send this email?

In case you need more information, please send an email to the address provided.

Thanks very much!

Kind regards,
Gerard

Blank Avatar
Jamal
04 September 2008


If you are working on a very big site, say, 40k or so blog posts, then you may want to change something or you will end up with out of memory errors.

In mod.sitemap.php:
Comment out the $DB->query for $entries in line 96
Add the following to replace it:

$sql = "SELECT * FROM exp_weblog_titles WHERE weblog_id = '$weblog_id' AND site_id = '".$PREFS->ini('site_id')."' AND status = 'open'";
$query = mysql_query($sql, $DB->conn_id);

Then comment out the foreach loop right under it and replace it with this:
while ($entry = mysql_fetch_array($query, MYSQL_ASSOC))

Good luck,
Jamal

Blank Avatar
Ben
05 September 2008


gerrard: sent it

jamal: thanks for posting the tip

Blank Avatar
Mike
24 September 2008


Do you intend to upgrade this plugin for EE 2.0 and if so, what will be the upgrade plan...namely, will I have to purchase another license for EE 2.0 if I purchase one now or will there be a free (within some reasonable time frame of course) or fair upgrade fee.

Blank Avatar
Ben
24 September 2008


i am planning a free upgrade for EE2.0

Blank Avatar
Mike
25 September 2008


Perfect! Thanks for the quick response.

Blank Avatar
MIke
30 September 2008


Is there a way to generate the site map information and have it displayed on a template? When I click on the "view sitemap" link in the module i receive an error.

Blank Avatar
Ben
01 October 2008


yes if you point your browser to the template in which the sitemap is called, for example http://www.mysite.com/site/sitemap then you should see it.

if you are getting an error when looking at the sitemap.php file then there is a problem with the xml output of the sitemap. please email me directly with the error message you are getting.

Blank Avatar
jasmanac
10 October 2008


Could you please resend me the code because I lost it and can't update files to the newest ones?

Thanks in advance!

Blank Avatar
Ben
13 October 2008


jasmanac: please email me with the email address you originally got the code with

Blank Avatar
misu
15 October 2008


hello

i run in a problem. my urls are like this : http://test.de/weblog/comments/test

in the sitemap i see only http://test.de/test

but this url is wrong. where i can cange the url to the right path?

Blank Avatar
Ben
15 October 2008


Modules › Sitemap

Blank Avatar
misu
15 October 2008


could fix it. the path was wrong

Blank Avatar
Adam
05 November 2008


I am having a wierd issue. When I add a new weblog entry I get a message saying there was an error when trying to notify Google. Anyone have any ideas?

Blank Avatar
Ben
05 November 2008


hi adam, most likely there is an error in your xml sitemap, or there is a connection error. i would think its the former as i assume you are using a live site. try viewing the sitemap in your browser and see if it throws any errors.

Blank Avatar
IdeaLady
05 November 2008


Ben, pages that are set with an expiration date in EE continue to show up in the sitemap after the date has passed. Google can't find them in the crawl, so this creates 404 errors.

Is there a way to automatically keep expired pages from appearing in the sitemap, or do I need to manual delete the pages from EE? It is not a large number of pages, but I expire class listings once the class is over.

Thanks!

P.S. Thank you for your help last week. The sitemap module is working great now--at least until the next time I break it. ;o)

Blank Avatar
Adam
06 November 2008


Ben, thanks for quick response...I tried viewing the sitemap in my browser (www.capitaldesign.ca/sitemap.php) and it loads the site (index.php) and not the actual xml file. Is the a sign of something I did wrong in the setup?

Blank Avatar
HansL
06 November 2008


Hi

Is your module also working with 'templates as files'? I use an extern editor to create and upload my templates. Hence the templates are not stored in the database, but live on the server.

Blank Avatar
Quena
06 November 2008


HansL,

I use the "templates as files" feature too, and it has not interfered with the Sitemap module. I presume that's because the "templates as files" feature is linked to the EE's template database (thats how I read the docs at http://expressionengine.com/docs/templates/flat_file_templates.html), but if I'm wrong I hope someone here will set me straight.

Blank Avatar
HansL
08 November 2008


Thanks, Quena!

Blank Avatar
Ben
10 November 2008


hi adam, just checked your site and the sitemap is working now. not sure what you did but it seems to have fixed it.

Blank Avatar
Lidia
20 November 2008


I get this error message when I click View Rendered Template: 'This XML file does not appear to have any style information associated with it. The document tree is shown below.

any ideas as to what's causing this?

my sitemap.php variable is currently set up as 'GROUP/sitemap' (it is the default EE 'site' group renamed). I have a blank template in this Group with {exp:sitemap:get} code.

Thanks

Blank Avatar
Ben
23 November 2008


hi lidia,

can you check if the page renders correctly when you view the template directly, i.e. www.yourdomain.com/group/sitemap

if it looks right there then its probably an issue with the sitemap.php file. check that you have edited the following line in that file:

$template = 'site/sitemap';

in your case it should be:

$template = 'group/sitemap';

Blank Avatar
Adam G
25 November 2008


In Modules > Sitemap - I need to add a weblog URL in the form of:

http://www.example.com/template_group/template/{entry_id}

Currently the module only seems to output based on the url_title, but my templates use the entry ID.

Thanks for your help.

Blank Avatar
Lidia
25 November 2008


Hi Ben

Thanks for your reply. I see that the module creates an XML file only and not a clickable links sitemap for users, according the comments above. Perhaps that is why the sitemap template is not displaying links?

What I am seeing when I view the template directly at http://www.domain.com/index.php/Group/sitemap is a page displaying both weblog URL paths and the module preferences (status, frequency, priority) spanning across the page. Is this rendering incorrectly?

Thanks again,

Lidia









Blank Avatar
Ben
26 November 2008


lidia: yes it sounds like the template is renderring correctly. which leads me to believe that the issues is with the sitemap.php file (see my comment above).

adam g: you can make it output the entry_id rather than url_title by changing line 122 in mod.sitemap.php (v1.4.2) to:

$location = $url.$entry['entry_id'];

Blank Avatar
Lidia
01 December 2008


Rendering incorrectly?

My sitemap.php file does contain 'groupname/templatename'. What I'm seeing when I view the sitemap template at http://www.sitedomain.com/index.php/groupname/templatename are all of the site weblogs and the module settings all on one line, spanning across the page. shouldn't this be rendering as a list or in some sort of order?

When I click View Rendered Template:





http://sitedomain.com/
2008-12-01
weekly
1.0


Thanks for your help.

Blank Avatar
KJ
08 December 2008


Great module/extension! I was up and running in minutes.

Blank Avatar
Daniel H
08 December 2008


Hey, just wanted to talk to you Ben about a potential bug fix I've developed for people hitting the following error:

Parse error: syntax error, unexpected T_STRING in /../system/core/core.functions.php(637) : eval()'d code on line 1

-Daniel

Blank Avatar
Ben
09 December 2008


lidia: that sounds about right. when you click on view rendered template you should see a file that is similar to the example at http://www.sitemaps.org/protocol.php#sitemapXMLExample

danielH: i haven't had any reports of this happening, can you describe when it happens and what your fix is please

Blank Avatar
Adam
10 December 2008


Nice module!

It would be great if you could also render an html version of the sitemap, in a list, for accessibility.


Blank Avatar
Rolf
18 December 2008


Hi,

I just installed your module today. Everything seems to work okay, and I can see a nice xml document when I view the sitemap.php file.

Unfortunately when I submit this to Google, I get an error returned saying that its the wrong format. From reading the threads above, I thought Google was supposed to see it as an xml document... but I have a feeling that it's not.

Here's the sitemap file: http://www.marlatt.ca/sitemap.php

Have I done something wrong?‎

Blank Avatar
Rolf
18 December 2008


Figures... I thought I'd re-submit the sitemap to Google right after I posted here and now everything works. Must have been a 'blip' the first time.

Sorry to bug!

Blank Avatar
Ben
18 December 2008


adam: thanks for the suggestion, maybe in the next release...

rolf: no problem, glad you got it working!

Blank Avatar
steve
05 January 2009


where's the render example? I cant buy it without see... help!!!!

Blank Avatar
Mike C
05 January 2009


Hello
I am interested in buying this extension, but maybe newbie question someone could answer..... Should I still be placing a robots.txt file on my server? and if so, does it need to point the bots to the sitemap file?
many thanks in advance

Blank Avatar
Ben
05 January 2009


steve: output is an xml sitemap, not much to see...

mike c: the sitemap is not related to the robots.txt file, but you can still have one if you like, no need to point to sitemap though.

Blank Avatar
arin
17 January 2009


hi, i'm just curious... i'm running multiple domains off one expression engine install (the old way, not using the multiple site manager) and i'd like to create a sitemap for each of those domains. is it possible to do that? (so far, i have a really nice sitemap that includes the links to *every* domain, rather than 1 sitemap per domain).

Blank Avatar
Ben
18 January 2009


i'm not sure how you've set that up but in theory it should work, as long as each weblog is for a different site (i.e. no weblog is used for more than one domain).

Blank Avatar
arin
19 January 2009


i have the multiple domains set up like this: http://expressionengine.com/wiki/Running_Multiple_Domains_or_Subdomains_or_Subsites/ and yes, each weblog belongs to it's own specific domain.

when i create the sitemap for mysite1, tho, i get a list of urls for mysite1, mysite2, mysite3, etc. so, of course, google errors out the extraneous urls. http://www.arinsattic.com/sitemap.php

it works *beautifully* other than that. is there some way in the sitemap.php file that i can make it only include the urls for the *specific* weblog (or domain)?

Blank Avatar
Ben
19 January 2009


hi arin, i'm afraid not. it works with MSM but unfortunately isn't compatible with your setup. as you say it'll work but google will spot the non-existent urls.

Blank Avatar
arin
20 January 2009


ben - ok, that's what i thought might be the case. at the moment, it's still creating a better sitemap than anything else i've tried! thanks for your help!

Blank Avatar
Mary Slater
04 February 2009


I paid and still havent received my link to download the code. How can i get that?

Blank Avatar
Matthew Callis
05 February 2009


When running this on the primary domain of a MediaTemple account you cannot cURL to the domain itself or you'll get the Apache test page. To fix this, you have to use the server IP address in place of the host in sitemap.php.

You can also rename sitemap.php to sitemap.xml and add this to your .htaccess to keep everything running smoothly if you already had a sitemap going:

AddType application/x-httpd-php .xml

Blank Avatar
Adam
05 February 2009


Great module! I'm having a little problem though. I'm using the include method to remove index.php from my url path and its interring with sitemap.php somehow. I had to add a "?" to my .htaccess file after index.php/ and I'm pretty sure thats what's causing the problem. I read on the comments above that someone else had a similar problem, but their solution did not work for me...(I think becuase of that "?") Here is what my .htaccess file looks like:

RewriteEngine on
RewriteCond $1 ^(weblog|our-work|article|catpage|embeds|reach-us|member|/flash|search|Forum_Name|site|cds|includes|services|P[0-9]{2,8}) [NC]
RewriteRule ^(.*)$ /index.php/?$1 [L]
RewriteCond %{http_host} ^capitaldesign.ca [nc]
RewriteRule ^(.*)$ http://www.capitaldesign.ca [r=301,nc]

Anyone have any ideas?

Blank Avatar
Erwin Heiser
06 February 2009


How easy/hard would it be to add the following search engines to the ping list? (it's a client request): live.com,
lycos.com
altavista.com
clusty.com
gigablast.com

Blank Avatar
Cormac
07 February 2009


Hi Ben, I'm having a similar issue with .htaccess as Adam above. No matter what combo of paths I use the sitemap is not rendered correctly in sitemap.php.

The information is in place on site/sitemap, but not in sitemap.php
http://www.coreenergy.ie/sitemap.php
http://www.coreenergy.ie/site/sitemap

I'm using the Include method to remove index.php in .htaccess
RewriteEngine On
RewriteCond $1 ^(member|includes|site|info|residential|commercial|faq|blog|about|privacypolicy|terms|contact|P[0-9]{2,8}) [NC]
RewriteRule ^(.*)$ /index.php/$1 [L]
RewriteRule ^/index.php/sitemap.php$ sitemap.php

And in sitemap.php I have:
$template = 'site/sitemap';

$sitemap_url = 'http://'.$_SERVER["HTTP_HOST"].'/index.php/'.$template;

Appreciate your help with this.

Cheers

Cormac

Blank Avatar
Ben
08 February 2009


Adam & Cormac: i think the problem might be that the site in your include list is conflicting with sitemap.php. i recommend you change the filename to xml_sitemap.php and try again.

Erwin: i have added live.com to the list (update the ext.sitemap_pinger.php file), however most of the others you mention get their search results from the major search engines already supported, so there is not much point in adding them. if you can find a ping url for them then let me know and i'll add them to the list.

Blank Avatar
Cormac
09 February 2009


Thats got it, thanks Ben.

Blank Avatar
Ben
09 February 2009


no problem, just don't forget to change sitemap.php to the new filename in the extension ext.sitemap_pinger.php

Blank Avatar
Jim Riley
14 February 2009


Hi Ben

I bought the extension back in Jan 08 and am only just getting around to installing! I have lost the licence info - please could you resend?

Jim

Blank Avatar
confused
16 February 2009


Does this work with the EE Pages Module?

I cannot tell from the description (unless I'm missing something). Anyone know? Thanks.

Blank Avatar
Ben
16 February 2009


at present this does not integrate with the pages module however it is planned for the future

Blank Avatar
Dom Stubbs
18 February 2009


Hi Ben,

I have just purchased the module with a view to setting it up for a client. One problem I'm running into is that some of their entry URLs are based on category URL titles and there appears to be no support for this built into the module. The module could be made a lot more powerful by giving access to key variables such as category_id, category_url_title, entry_id and url_title and allowing users to specify their own URL structures, as opposed to always placing the entry url_title at the end. Is anything like that forthcoming, or will I need to modify the code?

Thanks,
Dom

Blank Avatar
Ben
18 February 2009


Dom: funny that you should ask about this kind of thing, i've been working on basically the same functionality you have requested, and it should be ready in the next week or two.

Blank Avatar
Dom Stubbs
19 February 2009


That's great news, I look forward to giving it a try.

Blank Avatar
Jim Riley
21 February 2009


Ben - could you give me a hand with the final installation settings

I dont think I've quite got sitemap.php set up right, or inthe right place

Blank Avatar
Ben
23 February 2009


Jim, i replied by email

Blank Avatar
Dom
16 March 2009


Hi Ben, any news on the update? Sorry to be a pain, but it would be good to get this up and running ASAP. Thanks.

Blank Avatar
Ben
19 March 2009


just released version 1.6 which gives you full control over the structure of your urls. see the notes above.

Blank Avatar
marcel
20 March 2009


I have this error too when I visit http://www.greatnonprofits.org/sitemap.php
XML Parsing Error: no element found
Location: http://www.greatnonprofits.org/sitemap.php
Line Number 1, Column 1:

I know I'm not alone, but nobody has ever posted the solution.

Furthermore, I see a blank page whenever I visit
http://www.greatnonprofits.org/site/sitemap

I'm totally puzzled and any help would be welcome indeed.

Blank Avatar
Ben
20 March 2009


marcel, its not that a solution has never been posted, its just that the module is not set up correctly. first of all, find out why your site/sitemap template is blank. open the template and check that it contains {exp:sitemap:get} and nothing else. then go to the module settings and ensure that some weblogs or urls are included.

once you have the template set up correctly, the sitemap.php file should show the xml in the correct format.

Blank Avatar
Russ
23 March 2009


Hello,

I do not know how to change this setting? No matter what I do it remians, I want to make sure this is set to daily.... at the root domain....

http://www.domain.com/ 2009-03-23 weekly 1.0

Blank Avatar
Ben
23 March 2009


hi russ, i'm afraid its hard-coded in. i'll improve this in the next release. in the meantime you can change weekly to daily in line 69 of mod.sitemap.php to solve this

Blank Avatar
Jasper
26 March 2009


Hi,

Will this module be upgradable/work with EE 2.0 ?

Blank Avatar
Ben
27 March 2009


hi Jasper, yes the module will be upgraded to work with EE 2.0 for free.

Blank Avatar
Jerrod
30 March 2009


Any idea why I'm getting double & triple entries in the sitemap from one particular weblog?

Blank Avatar
Dom
01 April 2009


Thanks for the update, this looks like it should do the trick perfectly. Unfortunately I'm now seeing a huge number of duplicates though - 67 per entry in fact. In each of the site's weblogs. I'm going to look into it, but any pointers would be very helpful.

Blank Avatar
Dom
01 April 2009


I've fixed the duplicate entries bug by rewriting the $entries query and obtaining the category data via a secondary query. Two queries are needed as otherwise you run into big problems with weblogs/weblog entries that do not have categories assigned. I was seeing 67 entries per weblog item because I had a total of 67 entries within exp_category_posts. I'm happy to provide the updated code to anyone who needs it urgently, but I assume the next release will correct this.

Blank Avatar
Ben
02 April 2009


thanks for the heads up Dom. i have fixed this issue in version 1.6.4. it was happening for entries that had multiple categories assigned to them - thats how i overlooked it.
cheers!

Blank Avatar
Tim
15 April 2009


Hi -- I just installed the Sitemap module (on EE 1.6.7) but when I try to access the template I get the following error:

The following tag cannot be processed:

{exp:sitemap:get}

Please check that the ‘sitemap’ module is installed and that ‘get’ is an available method of the module


I followed the installation instructions closely -- what have I missed?

Blank Avatar
Tim
15 April 2009


Huh. Never mind. It started working all on its own a couple hours later.


Hi there! - I just realised that I have lost my registration email - You couldn't please send me the registration code again!?
Thank YOU!

Blank Avatar
Fernando
08 May 2009


Greetings, would like to purchase your module.. I have the Multiple Site Manager. How does this module work with the MSM module? Since I have several sites under it, will I need to purchase a separate license for each site? Or is this module applicable to all of the sites under the MSM module?

I thank you..

Best,

Fernando

Blank Avatar
Ben
08 May 2009


hi fernando, one license per EE installation, so you will only have to buy it once for all sites in your MSM, and you will be able to have a different sitemap for each site.

Blank Avatar
mary
14 May 2009


Ben,

my client initially wanted english as the primary language but have since decided to swtch to french as the primary is there a simple way to switch that without have to fix all the hard coded links with fr/ ?

Thanks

Blank Avatar
Matt Perry
14 May 2009


Hi,

We are interested in your add-on (it looks cool) but were wondering how it scales ... I'm assuming that it dynamically renders the sitemap on each access (ie -- it does not cache) First of all, is this true? Our sitemaps are likely to be large.

If this is true, then what experience to you have with how the module scales -- ie, are there performance problems associated w/ large sitemaps? Do the queries generated use indexes, etc? Our site is relatively high traffic, and we need to avoid expensive DB hits if possible. Also I saw the note above about needing to make a modification to avoid "out of memory" errors -- is this still necessary for large sites?

Any help you can provide would be great.

Thanks

Matt Perry
Grist.org

Blank Avatar
Ben
14 May 2009


hi matt,

yes, the sitemap dynamically renders on each access, no caching is done.

in terms of scaling, i have built in some functionality for making sure that the sitemap is rendered in manageable chunks, however the module was not originally designed for very large sitemaps.

there are two options available for seperating the sitemap as you will see above. make sure you stick to google's 50,000 limit, i would recommend a max of 10,000 at a time though to ease server load.

this should be fine if your sitemap is within the limits of thousands of urls. there was a case of a site that required millions of urls - in that case this module is unsuitable and a static sitemap is much more preferable.

hope that answers your question.

Blank Avatar
Matt Perry
15 May 2009


Hey thanks for the quick response!

Blank Avatar
Mark
17 May 2009


Hi Ben,

Will this module work if am importing xml product data and never accessing the publish and edit tabs?

Thanks,
mark

Blank Avatar
Ben
18 May 2009


hi mark,

if the data is being imported into weblog entries then yes, the sitemap module will still work. the only difference is that search engines will not be pinged, but thats not a big deal as sitemaps are usually checked every couple of days.

Blank Avatar
Albert
27 May 2009


Hi Ben,
just read your answer to Makrs question above as is answers half of my issues. The other one is: What if I have a single weblog entry like www.mysite.de/index.php/templategroup/template/productname, that can´t be reached via a link on my site. Will this URL still be included in the sitemap?
Normal sitemap generators who crawl a site starting from the top will never reach this page and thus have it not included in the sitemap. Since your tool doesn´t crawl the site, but works from "within" I assume, that those "orphaned" links will still be included.
Am I right?
Thanks
Albert

Blank Avatar
Ben
27 May 2009


hi albert,

if the weblog is set to "included" in the sitemap module settings then yes, the links to the weblog entries will be included.

Blank Avatar
Tori
28 May 2009


We have installed your module but the sitemap is not working. It never finishes loading. It just sits there. This was happening whether you went to the template directly or if you went to the /sitemap.php url. As a next step I tried creating a separate template group and placed the sitemap template in it. Now I can see a jumbled bit of links when I go directly to the template but I still get the loading issue when I try to go to /sitemap.php. I have double checked my variable in the sitemap php page so I know it is correct. Also, there are no spaces or anything else in the template. I'm not sure what the problem is. Please email to discuss further and I will send you actual links.

Thanks,
Tori

Blank Avatar
Lelia Thomas
15 June 2009


I emailed you a little over a day ago, because I bought this, but have not been able to download it. When I use my PayPal email address and the code I was sent via email, I receive an error that says "Incorrect email address or code." I emailed you, requesting I receive a copy via email, if at all possible.

I hope this is seen to quickly. I rather need this module, and I did pay for it.

Blank Avatar
Lelia Thomas
17 June 2009


I'm really frustrated by this. I paid for this ($50AUD) on the 14th, and because of what appears to be a broken system, I cannot get what I paid for, three days later. I've not heard from the developer, despite these comments and an email.

Blank Avatar
Andrew
18 June 2009


Not sure if this will help but I just purchased the module and noticed there was an extra space when I copied and pasted the code. Maybe double check that.

Blank Avatar
Lelia Thomas
18 June 2009


Thanks, Andrew. Unfortunately, spaces don't seem to be the problem. I'm thinking it might be my PayPal address, which I have go to a label in Gmail, and so it uses a + symbol in it. Perhaps this is causing some confusion for the script. Still, I would think the developer would be around enough to check his email or site every now and again, to fix this. :/

Blank Avatar
Ben
18 June 2009


hı lelia,
apologies for not getting back to you sooner, i was travelling the last few days and was not able to check email. ı'll resend the code to you. sorry again if you were frustrated by this.
ben

Blank Avatar
Marc
19 June 2009


I am looking for a good sitemap module for our expression engine site. Can the sitemap generated by this module be submitted to Google webmaster tools easily?

Blank Avatar
Ben
19 June 2009


hi marc, yes its very simple, you just need to submit the url to google. it will look like thıs:
http://www.yoursite.com/sitemap.php

Blank Avatar
Lelia Thomas
23 June 2009


I think I must be doing something wrong. I've enabled everything, have the proper code in my sitemap template, and have the sitemap.php file pointing to it. The page works, but it's picking up the rest of my site's design in some bizarre way. See http://www.leliathomas.com/sitemap.php All I have in my sitemap/index file is {exp:sitemap:get}. Do you know how it's pulling the rest of my site's design, all by itself?

Blank Avatar
Lelia Thomas
23 June 2009


I should probably clarify that this isn't a page that I'm going to use throughout my site, really, so I was just planning to have a plain and basic, white-background design for it.

Blank Avatar
Ben
23 June 2009


looks like a redirect ıssue. the page should look like this:
http://www.leliathomas.com/sitemap/index/

did you make the appropriate change to your .htaccess file? you need to make sure that sıtemap.php can be read and is not redirected.

Blank Avatar
EB
24 June 2009


Hi Ben,
I think I got it, definitely operator error, thanks!

Blank Avatar
David Webb
29 June 2009


I want to reiterate the need to add certain templates that are used like static pages, plus the wiki and forums that come with EE. Thanks!

Blank Avatar
Ben
02 July 2009


hi david, thanks for the comment. static pages can be added wıth the green 'Insert New Location' button in the top right.


Leave A Comment

name (required)
email (required but will be kept completely private)
website