Sitemap Module
*** Update: now compatible with EE2.0
The Sitemap Module is an Expression Engine add-on that automatically generates a configurable sitemap of your website and notifies search engines about changes in your site. It is meant as an SEO tool for site administrators that use the Expression Engine content management system.
Support can be found in the comments and in this EE forum thread.
Current Versions: 2.0.1 & 1.6.7 (released 8 February 2010)
* Works with ExpressionEngine 2.0 and ExpressionEngine 1.6
1. Concept
Sitemaps allow you to inform search engines about pages on your website that are available for crawling. A Sitemap is an XML file that lists URLs within your site, as well as additional information about each URL such as when it was last updated, how often its content changes and its priority within the site. The purpose of this is to help search engines to more intelligently crawl your website, with the ultimate aim of improving your pagerank.
Find out more about sitemaps at sitemaps.org
2. How It Works
The Sitemap Module consists of two parts - a module and an extension. The module allows you to select which weblogs to include in the sitemap and to set preferences for each weblog - its change frequency, priority and template. You can also add URLs to the sitemap and set their preferences.
The purpose of the extension is that every time an entry on your site is created or changed using the PUBLISH and EDIT tabs, several search engines are notified that your site content has changed. A Sitemap tab appears that allows you to select whether or not to notify the search engines. It is selected by default if you are creating a new entry. The search engines that are currently supported are Google, Yahoo, Bing, Ask and Moreover (the MSN search index).
You can use the following variables in the uls which will be parsed accordingly:
{url_title}, {entry_id}, {weblog_id}, {cat_id}, {cat_name}, {cat_url_title}, {entry_date}
* If an entry is assigned to multiple categories then only the first category will be used in parsing
If your sitemaps are very large then you can define the start index and limit of the number of entries shown (Google's limit is 50,000). For example:
{exp:sitemap:get start="0" limit="10000"}
You can also define the start index and the limit in the url in the following way (since version 1.6.1, requires curl):
http://www.mysite.com/sitemap.php?start=0&limit=50000 http://www.mysite.com/sitemap.php?start=50000&limit=100000 http://www.mysite.com/sitemap.php?start=100000&limit=150000
This allows you to submit multiple sitemaps to Google and to use sitemap index files to group multiple sitemap files. Please ensure that you have version 1.6.1 of the module or later installed and that you have updated the sitemap.php file.
Note: The EE2.0 version does not contain the sitemap pinger but it is coming soon!
3. Installation
Download and unzip sitemap.zip, then follow the steps below.
For EE2.0:
- Open the sitemap_2_0 folder
- Upload the entire sitemap folder to the system/expressionengine/third_party/ folder
- Create a template called sitemap and place the following line it: {exp:sitemap:get}
- Upload sitemap.php to the root directory of your website and change the template variable in it if necessary
- Install the Sitemap module (Control Panel -> Add-Ons -> Modules -> Install)
- Set the sitemap preferences (Control Panel -> Add-Ons -> Modules -> Sitemap)
- Use the links to submit your sitemap manually to Google and Yahoo
For EE1.6:
- Open the sitemap_1_6 folder
- Upload the sitemap folder to the system/modules folder
- Upload lang.sitemap.php to the system/language/english folder
- Upload ext.sitemap_pinger.php to the system/extensions folder
- Create a template called sitemap and place the following line it: {exp:sitemap:get}
- Upload sitemap.php to the root directory of your website and change the template variable in it if necessary
- Install the Sitemap module (Control Panel -> Modules -> Install)
- Enable the Sitemap_pinger extension (Control Panel -> Admin -> Utilities -> Extensions Manager -> Enable)
- Set the sitemap preferences (Control Panel -> Modules -> Sitemap)
- Use the links to submit your sitemap manually to Google and Yahoo
4. Download
Each individual license costs $39.95, which allows you to use the module on one installation of EE. You must purchase a license in order to download the Sitemap Module. Once you have completed payment you will be sent a code that will allow you to download the file.
By purchasing the Sitemap Module you agree to the license agreement.
If you have already purchased the Sitemap Module then you can download it by entering your email and code below.
5. License
By purchasing the Sitemap Module you agree to the following conditions:
- One license grants the right to perform one installation of the Sitemap Module. Each additional installation requires an additional purchased license.
- You may not reproduce, distribute, sell or transfer the Sitemap Module, or portions thereof, to any third party.
- All copyright and proprietary notices within the Sitemap Module files must remain intact and unaltered.
- The Sitemap Module is provided "as is", without warranty of any kind.
- You assume all risk associated with the installation and use of the Sitemap Module.
6. Changelog
Version 2.0- Converted to an EE 2.0 compatible module (both versions available in download)
- Added time to lastmod field in sitemap
- Entries with future entry dates now excluded in sitemap
- Added {entry_date} variable in location
- Replaced Live.com with Bing.com in sitemap pinger
- Fixed a bug caused by last update in which entries were shown multiple times if they were assigned to multiple categories
- Added limit field to sql query
- Fixed update weblogs bug caused by last update
- Added ability to change settings for site index page
- Added link to show/hide excluded locations and weblogs (thanks to Todd for the suggestion)
- Added option for start and limit parameters to urls
- Added variable parsing
- Added start and limit parameters to allow for multiple sitemaps
- Added functionality to prevent expired entries from appearing in sitemap
- Optimised sql queries and reduced php memory requirements
- Fixed a bug that was causing problems when checking for updates
- Performs checks on the edit date to ensure lastmod is formatted correctly and fixes bad dates
- Replaced template dropdown box with url input box
- Locations are now specific to individual sites (MSM compatible)
- Added confirmation box when deleting locations
- Sitemap pinger now ignores weblogs that are excluded from the sitemap
- Fixed a bug that was creating the link to the rendered sitemap with a missing slash
- Fixed a bug that was causing problems on some servers when installing the module
- More template options added to template selection list
- Changed naming of status options for clarity
- Added a check to prevent sessions from being started more than once
- Fixed a bug that was causing the tab body of other extensions to be overridden
- Fixed a bug that was causing the first template of each group to not appear in template selection list
- Fixed a bug that was causing double slashes to be added after site url in some cases
- Fixed a bug that was causing tabs put on the publish page by other extensions to be overridden (thanks to Leevi Graham)
- Sitemap tab added to the publish and edit pages in the control panel, allowing you to select whether or not to send a sitemap ping to search engines
- Template group names added to template selection list (thanks to Victor Gutierrez for the suggestion)
- Fixed a bug in the extension that was causing errors when entries were being submitted from stand-alone entry forms



7. Comments
harry
05 November 2007
Module works perfectly! Very clean interface. Thanks for this!
Rick
05 November 2007
Excellent module! Very well thought out and designed. Also very clean and simple to use. I had it up and running within 15 minutes and google is now showing 99 urls mapped versus the 17 it was previously! It is also nice to know that it is always notifying the search engines when I make changes. I don't have to do a thing anymore.
Thank you for sitemap! It has saved me a ton of time.
Shawn
13 November 2007
The module is a snap to install. In 10 minutes, it's up and running and outputting beautifully. I couldn't have asked for a better module.
I can't tell you ho much time you've saved me with this module.
Thanks a million.
Ben
14 November 2007
Version 1.1 is now available and has some new little features, but more importantly it addresses a problem that version 1.0 had with stand-alone weblog entry forms.
Roman
21 November 2007
hi,
fantastic application - just what i've been waiting for!!!
as i run a news site which is listed in google news it would be great if i could limit the entries to the last 3 days cause this it what google news wants me to do...
piniging google doesn't work for me and if i click on "View Google's index of your website" i get all pages listed in google - not just my pages...
nevertheless some fantastic job you did!
thanks' again
cheers
roman/berlin/germany www.berlinista.com
Ben
22 November 2007
hi roman,
i had a look at your sitemap and the locations don't seem to have your website base url in them, i'm guessing that that's why pinging google doesn't work. what build of EE do you have installed?
Roman
22 November 2007
hi,
Build: 20070622
actually i don't know how to get the url into the sitemap.
thanks'
roman
Ben
23 November 2007
roman, the url is automatically pulled in using the $FNS->fetch_site_index() function. from your control panel go to Admin -> System Preferences -> General Configuration and check if the "URL to the root directory of your site" is set.
Roman
02 December 2007
hi,
this works!!!
thanks' a ton. somebody built my site and obviously didn't do everything right. after receiving all the money he now refuses to help and i'm lost.
thanks' again!
Ben
02 December 2007
no problem, glad that worked.
mark
04 December 2007
Hi,
Great idea for this module! I have a question regarding sitemaps urls and EE's pages module urls though. The sitemap urls being created include /pages/page_name (the template name) even though the url I am specifying is /project/page_name as seen below:
sitemap module creates:
http://www.1111camino.com/dev/index.php?/pages/the_condos
while the EE display url is:
http://www.1111camino.com/dev/index.php?/project/condos
Is this in essence looking like duplicate content to the SE's?
Any comments appreciated!
Thanks,
Mark
Ben
04 December 2007
hi mark, the EE display url, http://www.1111camino.com/dev/index.php?/project/condos, is that url using the pages module? if it is then you could set the status of that weblog to closed and specify it as a url in the sitemap.
if you can post the url to your sitemap here, or email it to me then i could take a closer look.
mark
05 December 2007
Hi Ben,
Yes http://www.1111camino.com/dev/index.php?/project/condos is the URL I have assigned to that entry in the pages module. I am a bit confused when you say to close the weblog (which I have named "pages" also) and specify it as a url in the sitemap. If I close the weblog....it no longer is live and doesn't display at all in the sitemap.
http://www.1111camino.com/dev/index.php?/site/sitemap is the url to the current sitemap.
I'm new to EE and very light on coding so if my questions seems odd...that's why :)
Thanks Ben!
Mark
Ben
05 December 2007
from the sitemap module screen you can set the status of each weblog to open or closed. selecting closed does NOT close the weblog, but simple means that it is not included in the sitemap.
if you do this, you can then press the big green "insert new location" button in the top right, and add the url's that you use with the pages module manually.
i hope thats clear enough
mark
05 December 2007
Hi Ben,
Excellent! Thanks for that clarification. Its working great now!
Mark
Chuck
14 December 2007
I'm puting up site in a couple of weeks and am very interested in using your Sitemap Module. My question is does it ping the search engines from a stand alone entry form?
Ben
14 December 2007
hi chuck, yes it does ping search engines on submission of a stand alone entry form.
Kevin Goeminne
23 December 2007
Hi,
I just purchased the module it worked fine in my offline copy. But when i try to view the renderd map it seems to fails.
I think i set up everything correct you can fine the sitemap here : http://www.geboortelijst.be/sitemap.php you will see it keeps loading.
But the template is correct http://www.geboortelijst.be/index.php/sitemap and gives a result. Can you give me any hints on whats going wrong i cant wait to see the results of implementing these site maps.
Kevin,
Ben
26 December 2007
hi kevin, try removing any spaces or blank lines before the exp:sitemap tag. if that doesn't solve it then it may be a redirect problem. test it with some sample text and let me know if that helps.
kevin
26 December 2007
Hi ben,
Nope removing the tag or placing other text in it has the same effect it seems to be loading forever.
Is there something else i can try? Would it not be easyer to just include the template?
Phil
02 January 2008
Having troubles getting the module to work. Are there known issues if you are using an .htaccess file to remove the index.php from the EE URL?
Oh, wait...the problem was I have the site offline. The sitemap.php doesn't play nice with the System Offline template.
A different problem though is I cannot select the template I need. The templates are not showing up correctly in the template drop down on the Sitemap CP.
Quena
03 January 2008
Anybody else experiencing double slashes ("//") in the sitemap URL
http://example.com//article/1/
A suggestion, to remove the trailing slash from my {path}, did not work (click my name).
I am running EE 1.6.0 and am using the exclude method to remove index.php from the URL.
Ben
04 January 2008
Kevin: the template is included, it is called sitemap_template.txt
Phil: can you please elaborate a bit on what happens when you click on the template drop-down.
Quena: i have emailed you with the solution. i will be posting an update shortly that fixes this problem.
Quena
04 January 2008
Works like a charm!
Sufian
07 January 2008
Hi,
I purchased the lic on 12/31/07 however I never got a code. Where can I download the files?
Ben
08 January 2008
Sufian: the code was sent to you, but blocked by your spam filter. i have sent it again.
Russ
09 January 2008
My template keeps putting in the // and I have removed the back slash from root, any ideas?
stefan
10 January 2008
Hi Ben,
can I see a demo of your Module? I'm interessted in the layout and the ability to style via CSS.
cheers
Ben
10 January 2008
Russ: version 1.2 contains a fix for this.
stefan: i think you may have missed the point of the module. it creates an xml sitemap (also known as a google sitemap) of your entire site. there is no layout or styling. hope this clarifies things.
Sufian
11 January 2008
Ben, I checked my spam settings and still have not seen any emails re the code. I just sent an email via another email account. Please send to that one.
Leevi Graham
20 January 2008
Ben: I think there could be an issue with SiteMap Pinger and LG Better Meta. It seems that your tab is overriding any other tabs.
You may need to check for previous new tabs.
Cheers
Ben
21 January 2008
hi leevi, thanks for letting me know about that, i have added the fix to the current release. cheers, ben
current
22 January 2008
Hi Ben,
i purchased sitemap but have experienced an issue when trying to view the rendered sitemap template:
Parse error: syntax error, unexpected T_STRING in /../system/core/core.functions.php(637) : eval()'d code on line 1
What happened here?
Alex
06 February 2008
Working like a charm! Thank you! But I’ve got two questions. Can I use this module for my wiki’s articles? And what exactly is “Insert new location” button? For what reason should I use it?
Ben
06 February 2008
hi alex, i have not tried using it with the wiki module, but i assume not since the sitemap module reads entries from the weblog entries table.
the “Insert new location” button lets you insert additional urls into the sitemap. for example, if part of your site is external to EE then you could manually add the urls to it. or if you have a template that you want to include in the sitemap that doesn't have any associated weblog entries then you could add its url too.
Alex
07 February 2008
Well… Everything was OK, but I’ve got a strange problem starting this morning. I tried to add url using site modem, but when I’m trying to access it in admin/modems panel all I’ve got is a blank page. Looks like modem itself is working, ‘cause I see its result in publish page and Goggle can access my map without problem. But I cannot configure modem any more. Using it in admin/modules leading to blank page only. I reinstalled everything using fresh downloaded files, but still can not see configuration panel of modem. Please, help.
Alex
07 February 2008
Suddenly everything is back to normal. I believe this glitch is somehow connected to the Goggle itself. ‘Cause everything was fixed as soon as I resubmitted my sitemap in Goggle.
Ben
07 February 2008
ok, glad you got it sorted
Brendon Carr
09 February 2008
I have a feature request: Notifications of updated sitemap to Google, Yahoo et al only in the case of content being placed in a certain status specified by the user -- for example, "Open". For those of us who have a draft-in-progress workflow, immediate notification of so-called "updates" is premature and could result in bots trying to index content that is not ready yet. Don't they penalize when they visit and can't find the content?
Rushing
12 February 2008
Has anyone used this on MediaTemple GS?
Roman
13 February 2008
Hi Rushing, i've been on MT GS (till last week) and it worked perfectly.
To all: after moving my webspace and updating the module to 1.2 i now get this: error on line 1 at column 47: Space required after the Public Identifier
Where exactly do i have to add space? using the standard file which came with the update.
Sorry for being too much of a noob...
Kevin
17 February 2008
Hi,
I'am having issue with the curl this works fine when i try to call any websiite outside my server. But when i try to call a link that is on the same server it does not work.
How can i fix this? I bought this module a month ago and still was not able to use it.
I hope to have an anwser fast thanks in advance,
Ben
17 February 2008
kevin, can you please explain what the problem is? its unclear to me.
Matt Johnson
18 February 2008
Hey Ben,
Could you take a look at this thread please.
Thanks
Ben
18 February 2008
roman, it seems it was a memory issue with your service provider, see this thread
matt, i am working on this and will have an update for you shortly
Ben
18 February 2008
matt: version 1.3 contains a fix for this
brendon: this is already possible with the status options (new naming convention in 1.3 for clarity)
Roman
22 February 2008
Hi,
is there any chance that you might offer some feature which lets me add more sitemaps that get updated whenever i post a new article? I have two other sitemaps - one for google news international and one for the german google news which i'd have to update using a cron job. being able to add those to the module would be the far more elegant solution :-)
just asking...
Jon Robinson
22 February 2008
nice, thanks!
Street Trees
28 February 2008
Great tool. Looks like it will be a big help to those who use Google Webmaster Tools.
Dion
28 February 2008
Dear Ben,
Some 'lastmod' tags seem to be rendering the following dates: 2005--1-1-
While other render fine: 2007-11-06
Google doesn't like those dates and classifies them as unknown dates/renders as an error.
Any idea what causes these lastmod tags to be rendered like this?
Thanks.
Mark Fleming
28 February 2008
I own 1.2. How do I download the 1.3 update?
Ben
29 February 2008
dion: i don't know why this might be happening, but i'll investigate. can you email me the link to your sitemap please.
mark: just enter your email and code into the download form on this page and you will get the latest files. upload them to your server and you're done. you can also see the update changes in the changelog.
Mark Fleming
01 March 2008
Upgraded to 1.3 and I get this:
XML Parsing Error: no element found
Location: http://www.homerobots.com/sitemap.php
Line Number 1, Column 2:
By the time you look at it I might be back to 1.2.
Mark Fleming
01 March 2008
Never mind, sorry. We did something wrong on our end.
Robert Scanlon
07 March 2008
I'm getting this error after reinstalling my entire site (it worked fine before - great module, Google loved it, but we had a server crash and I've just rebuilt everything) - the last thing to do was install the sitemap module. I've tried a few variations of settings. Any clues?
XML Parsing Error: syntax error
Location: http://www.hotyogadoctor.com/sitemap.php
Line Number 1, Column 50:
-------------------------------------------------^
Thanks!
Robert
PS. Sitemap is at http://www.hotyogadoctor.com/sitemap.php
Robert Scanlon
07 March 2008
If I view the rendered template at:
http://www.hotyogadoctor.com/index.php/site/sitemap/
I get the sitemap!
So what is the issue - why doesn't sitemap.php render that for me? What have I done wrong!
Cheers,
Robert
Robert Scanlon
07 March 2008
OK I think I have it now - despite full propagation, I'm still showing some files at another host (temp while we fixed our crash). It appears sitemap.php is trying to go via the old dns - I have no idea why, as the domain is removed from that site and everything else is fine, hopefully it is a short term issue.
Cheers,
Robert
Ben
08 March 2008
hi robert, it seems to be working now.
i'm currently at SXSW and just met the ellislab team and some EE member communities!
Robert Scanlon
08 March 2008
Hi Ben - that sounds exciting!
Tnx for checking, appreciated. It did take a little while, but resolved itself. It's a great app, thanks (Especially if your server goes down with no backup and you need to tell Google where to go to find all your pages again).
It was a weird propagation issue, despite a full 2 days and everything working fine, that particular url was trying to resolve at the temp host despite the fact that it (that filename) had never been hosted there.
Any gossip on EE2.0 at SXSW?
gregg
10 March 2008
I'm having two issues with sitemap on my site.
1.) I cannot enabled the extension site pinger. I click enabled extensions but it never turns it on.
2.) The urls logged into the sitemap are not the full url's..
i.e. /blog_entry_name
when it should be
i.e. /reviews/detail/blog_entry_name
Sharif
17 March 2008
Hey Ben,
I'm still having trouble with the installation, and posted details and error messages in this thread. (I also sent you a PM with a little more info.)
Any advice would be most appreciated...
Gregg
17 March 2008
Ben,
I have been unable to get any support on your component? Can you please drop me an e-mail on how to get my extension fixed as well as how to get the sitemap.php working when .htaccess is setup to remove the index.php?
Gregg
17 March 2008
A follow up on my two issues which I have found resolutions for:
1.) If you can't enabled the sitemap pinger extensions, check to make sure your path.php and config.php are set to 666. I believe this was the source of the issue.
2.) If you are using the .htaccess method to remove index.php, you will need to do add the following to allow sitemap.php to be picked up on your site.
RewriteRule ^sitemap.php$ /index.php/site/sitemap_name/ [L]
This is a great module, however I have waited at least a week to get some help from Ben with no luck. I can understand this if this product were free, but when your charging you should have a better support system in place to help out the paying customers.
Ben
17 March 2008
hi gregg, i apologise that this issue took a while to resolve. unfortunately it coincided with me being abroad, but also as it turned out it was not a problem with the sitemap extension.
anyway, i hope you are satisfied with the module and again sorry for the inconvenience.
Shelomo
27 March 2008
I've been trying to get thi up and running but i still get the home page coming up when i hit http://www.weisslurie.com/sitemap.php the site map does show up at http://www.weisslurie.com/site/sitemap
Im using the htaccess to remove index.php and i tryied the above code
RewriteRule ^sitemap.php$ /index.php/site/sitemap_name/ [L] whicj didnt seem to work
Shelomo
27 March 2008
Well after finding this code on the EE forums i got it to work
RewriteRule ^sitemap.php$ /index.php/site/sitemap/ [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule ^(.*)$ index.php?$1 [L]
jasmanac
04 April 2008
I don't see Sitemap tab when I want to publish something?
Ben
05 April 2008
Is the sitemap pinger extension enabled?
jasmanac
07 April 2008
Sorry I didn't notice that pinger extension is not enabled.
Deepvision
16 April 2008
Hi,
I want two types of sitemap, an XML one for the search and a visible one for site visitors. This may be a stupid question, but can the module create both?
Thanks.
Ben
16 April 2008
this module creates an xml sitemap only. i would think if you wanted to create a sitemap for visitors that it would have to be styled, plus you would probably want to have more control over the content
Guus ten Brink
03 May 2008
Maybe I'm stupid, but I can't get it to work.
I get the following error:
'This page contains the following errors:
error on line 1 at column 1: Document is empty
Below is a rendering of the page up to the first error.'
Besides that I cannot insert a New Location?
Any help appreciated.
Ben
03 May 2008
guus, please post the link so i can check the error message.
the New Location issue is now fixed so please download latest version
Guus
03 May 2008
Hi Ben,
Thanks for your quick reply!
It seemed that I didn’t correctly changes the template variable in the sitemap.php
I downloaded a new version, so the New Location function is now working!
The only thing I don’t understand is where the sitemap.xml is generated?
Regards,
Guus
Ben
03 May 2008
no problem, glad you got it working
ah, that is where the magic happens. if you look near the top of the sitemap.php file then you will see that the content type is set to xml, and the xml code is then generated by the module.
cheers,
ben
Guus
03 May 2008
Yes, I saw that but I must have an .xml file to submit my sitemap manually to Google and Yahoo!?
Where is the sitemap.xml?
Ben
03 May 2008
you should submit the url of your sitemap.php file, they will read it as an xml file
Guus
03 May 2008
Aha, now I understand!
Thanks Ben
Dave
05 May 2008
Hi,
I'm having trouble when installing the module via the Modules tab.
The error I'm getting is:
MySQL ERROR:
Error Number: 1074
Description: Too big column length for column 'url' (max = 255). Use BLOB instead
Query: CREATE TABLE IF NOT EXISTS `exp_sitemap` ( `id` INT(6) UNSIGNED NOT NULL AUTO_INCREMENT, `weblog_id` VARCHAR(10) NOT NULL, `url` VARCHAR(300) NOT NULL, `site_id` VARCHAR(10) NOT NULL, `status` VARCHAR(10) NOT NULL, `change_frequency` VARCHAR(10) NOT NULL, `priority` VARCHAR(10) NOT NULL, PRIMARY KEY (`id`));
Can you help?
Ben
05 May 2008
it looks like your database is limited to 255 characters for a varchar field. i have added a fix to the module, please re-upload the new files and try again
Dave
05 May 2008
Works like a charm. Thanks Ben.
Very impressed with the speed of reply too.
Dave
05 May 2008
I also had to come back and say I think this module is great. Not just because it meets a need superbly, but also because the attention to detail of things such as the links to Google and Yahoo sitemap submission pages makes me feel you must have done a good job with the bits I'm never going to look at.
Well done.
Ben
05 May 2008
thanks dave, i appreciate the compliment
James
08 May 2008
Is there any way to make "Send sitemap ping to search engines" check box checked by default when editing an entry. I have a situation where this is desired.
Ben
08 May 2008
hi james, this cannot be done but i will add it as an option in the next release.
in the meantime you can make it work by changing line 248 in ext.sitemap_pinger.php from:
if($IN->GBL('C', 'GET') == 'publish')
to:
if(1)
James
08 May 2008
Ah ok....
I noticed a few problems in my output. Some of the dates being returned are kinda strange. I have some dates like this:
1225-42-56
1228-97-16
1233-81-00
1224-82-08
etc...
This is obviously throwing up some warnings with Google. Any ideas?
Going in and editing the post and saving it does fix the problem. But it is kinda annoying.
Ben
12 May 2008
the latest version checks and fixes bad dates
Simon
12 May 2008
Hi,
I've bought the module and love it. I think I’m missing something obvious though so please excuse me if the question is obvious.
Google needs the sitemap to be created at the root directory but the only module related file I can see there is the sitemap.php file (which returns an error when visited www.alchemea.com/sitemap.php), not that Google seems to accept .php files as sitemaps anyway.
I do have an xml page but this is at: http://www.alchemea.com/index.php/global/xmlsitemap. How can I get this to the root directory?
Thanks
James
12 May 2008
Google will accept "www.alchemea.com/sitemap.php" as a valid sitemap feed.
Have you enabled the module and extension?
In your template /global/xmlsitemap do you only have the following: {exp:sitemap:get}
Have you modified the template variable in sitemap.php to point to that template (/global/xmlsitemap)?
Simon
13 May 2008
Hi James,
This is clearly the day of me missing the beeding obvious. The template variable was incorrect and all now works fine.
Thank you.
Simon
13 May 2008
Hi James,
This is clearly the day of me missing the beeding obvious. The template variable was incorrect and all now works fine.
Thank you.
Simon
13 May 2008
Hi James,
This is clearly the day of me missing the beeding obvious. The template variable was incorrect and all now works fine.
Thank you.
BenB
16 May 2008
Hi Ben, looking at the code I take it that slashes are supposed to be added to the end of entry title urls (for example)? For some reason this is not happening on our sitemap: http://www.cafedelabourse.com/sitemap.php
Does any setting in Expression Engine affect that?
thanks, Ben.
Ben
16 May 2008
actually no... slashes aren't added to the end of the title urls. i really don't think it makes a difference to any web browsers or google though. or do you need it for some other reason??
BenB
16 May 2008
Just for SEO purposes, so the urls are the same everywhere.
Laurent C
18 May 2008
Hi Ben,
I just installed your sitemap module. It works great.
Do you plan on adding the ability to include wiki articles and forum entries, too?
That would be fantastic ...
Ben
18 May 2008
BenB: if you really want a slash at the end then you can change line 122 in mod.sitemap.php to:
$location = $url.$entry['url_title']."/";
Laurent: i will definitely consider it for a future release, though right now i can't say exactly when that might be...
Matt
02 June 2008
Hi Ben,
I am getting this error at the top of my sitemap module page in the cp:
Notice: Undefined offset: 1 in /home/green/webapps/htdocs/admin/modules/sitemap/mcp.sitemap.php on line 464
When I try to look at the sitemap ( http://www.greenmarketing.com/sitemap.php ) I get the following error:
XML Parsing Error: no element found
Location: http://www.greenmarketing.com/sitemap.php
Line Number 1, Column 2:
-^
Strange think is, it was working fine, then my host's (webfaction) data center had a fire and everything closed down for a day and a half. Everything is back-up but my queries to my database are very slow. I am not sure if that has some how screwed things up.
Would be glad of some help.
Cheers,
Matt
Matt
03 June 2008
I think it may be fixed. I have a feeling it was all due to a network issue and the problems at the data center.
By the way, this is a great module. Thank you!
Matt
Ben
03 June 2008
cool, thats good to hear.
thanks, i enjoy working on it!
alex
05 June 2008
paid but where is the "code"?
Ben
05 June 2008
sometimes takes a bit of time for the payment notification to come through but you should have it by now
alex
05 June 2008
Am I looking for a notification from you of paypal?
Ben
05 June 2008
alex, the code was sent to your email. i'll resend now, but please check your spam folder in case it was accidentally put there
Ken
06 June 2008
Works like a dream, thank you!
DJ
18 June 2008
Ben,
Great plugin. However, I need your help to get it working properly. I have installed it fine, created a sitemap template, set the right template path in sitemap.php, and removed index.php from the file path since I use .htaccess. I use the 'exclude method' so I added sitemap.php to make sure I can access it. No dice.
I get:
"This page contains the following errors:
error on line 1 at column 1: Extra content at the end of the document
Below is a rendering of the page up to the first error."
Any help appreciated.
Ben
18 June 2008
hi DJ, please ensure there are no blank lines or any other text before or after the {exp:sitemap:get} tag in your template. if that doesn't help then view the source code of the rendered page and check if the xml text is appearing there.
DJ
19 June 2008
No space before or after in the template.
There is no source code on the error page at all – not even for the error message (Safari). In Firefox all I get is a blank page.
I'm thinking this is related to my .htaccess set-up, yet I've included the sitemap.php and removed index.php from the path.
Any other suggestions?
Ben
19 June 2008
can you show me the appropriate line in your .htaccess file please. it should look something like this:
RewriteCond $1 !^(images|system|themes|index\.php|sitemap\.php) [NC]
DJ
20 June 2008
RewriteCond $1 !^(images|name-of-my-system-folder|themes|index\.php|img|css|js|client|favicon.ico|exclude.html|sitemap\.php) [NC]
Ben
20 June 2008
that looks right. can you look at your sitemap template url, so for example www.my-site.com/site/sitemap, and check if it shows up correctly there. if it does, then make sure that the $template and $sitemap_url variables are correctly set in sitemap.php
if you still can't solve it then send me an email and i can help you troubleshoot further.
DJ
21 June 2008
Fixed it, there were a couple things:
1) I was using the Pages module and had a template called sitemap in the root. I added your sitemap template to it's own template group.
2) I was missing '/' in the $sitemap_url
3) When you copy and paste paths from the forum, it uses curly quotes.
Thanks for you help, this is a kickass module.
Ste
03 July 2008
Hi Ben,
I've just purchased the sitemap module but after playing about with it, am I right that it doesn't dynamically generate links for pages in EE's static pages module? I have 85 static pages on my site and don't want to be adding them all manually via the Insert New Location button; not to mention that I don't want to have to manually maintain the static pages within the module if any of our multiple users add, remove or edit any of the pages.
Thanks for any advice,
Ste
Ste
03 July 2008
Hi Ben,
I've just went through the EE thread and unfortunately, it looks like the module doesn't support EE's static pages module - you said in March 2008 that it's something you'd like to work on, have you got any sort of timeline for this at all?
I also have another question - I have a weblog (news) that has a template group (news), but within this group, as well the the main group for news stories (news/index), I also have other templates for other categories of news item (news/press-releases, news-case-studies, etc).
I have figured out how to display the main news stories, but how can I also display the news/press-releases entries?
The same issue also happens in my people weblog - I have a template group named 'about,' but besides about/index, I also have about/staff, about/trustees, about/partners, about/supporters, etc, and each template displays the content in different ways but so having the entire weblog open in news/index just doesn't work right for me.
I know I can add the URL's manually, but I'm talking about hundreds of entries here.
Again, any advice would be appreciate if I'm missing something here.
Thanks,
Ste
Ben
04 July 2008
hi ste,
the pages module is indeed the priority for the next major release, and i realise it was in march when i mentioned it but unfortunately other projects have delayed its release. so i'm afraid i can't say when it will be available, but it definitely will become a feature of the module.
regarding your news and people weblogs, because of the complex way in which weblog entries can be displayed, in your case it appears to be by specifying categories, the module can currently only be used to display one template for each weblog. this is because people use the weblogs in many ways. for example on a specific template you may only display weblog entries that are in a specific category or have a certain status. the module doesn't support all of these ways of displaying content unfortunately.
if you think that the module is not suitable for your particular site and would prefer not to use it then i would be happy to refund you. please email me if this is the case.
all the best,
ben
Bill
08 July 2008
Hi Ben,
I am excited about this module! However I am getting the following error When I try and "View Rendered Sitemap", however I can view the site map at its URL.
The following tag has a syntax error:
{exp:lg_polls:poll}
Please correct the syntax in your template.
Is this a conflict with the actual module, or a novices user error?
Thanks for your insight,
Bill
Ben
09 July 2008
hi bill, clicking on "View Rendered Sitemap" should take you to the url, which you say is working... so i'm confused.
the site/sitemap template should only have one line in it:
{exp:sitemap:get}
let me know if this helps
Kim
11 July 2008
Hi,
I have just tried to uninstall Sitemap, but when I do I get the following error when submitting a new post in the publish page. When I reinstall Sitemap the problem goes away, but returns again if uninstalled:
MySQL ERROR:
Error Number: 1146
Description: Table ‘user_ee.exp_sitemap’ doesn’t exist
Query: SELECT status FROM exp_sitemap WHERE weblog_id = ‘1’
Kim
11 July 2008
Problem solved - I needed to disable the sitemap pinger in the extensions manager
cheers
Kim
Leslie Morgan
12 July 2008
Hi, I just purchased the module but didn't get the email. I checked all my spam folders, etc. Is there something I can do?
Ben
12 July 2008
hi leslie, i've resent it to you
Boyink
22 July 2008
Hey Ben -
I just installed the module and got it working in pretty short order. The only hitch I ran into was on my site I've not removed index.php, I've renamed it.
This caused an error when trying to load the rendered sitemap due to the hardcoded "index.php" in sitemap.php. Changing that reference to my renamed index.php name got me up and running -- but it would be nice if the value was pulled dynamically from Admin > System Preferences > General Configuration > Name of your site's index page.
Ben
29 July 2008
i don't think that many people rename their index.php file to something else. most either keep it or use their .htaccess file to hide it from the url.
thanks for the suggestion though!!
Courtney
31 July 2008
Hi, I'm having a hard time getting Google to recognize this as a valid sitemap. Please forgive my naivete, but am I supposed to give Google the address to the sitemap with the .php extension as added to the root folder or as a .xml extension? Does this module automatically create a .xml file? Thanks.
Ben
31 July 2008
yes, you give google the url to the sitemap.php file, for example:
http://www.mysite.com/sitemap.php
the headers in the php file make it appear to be an xml file, which google can recognise and read
triom
02 August 2008
Hello Ben,
I purchased this plugin a couple months ago and it's great! I'd like to also say that it would be wonderful if the sitemap covered the wiki as well. What are your future plans with the sitemap module?
Best,
triom
Roman
15 August 2008
Hi,
need to dive into the code in a minute. Looking for the place where i can add the "article id", as every of our urls has an at least three digits number, because of google news. Your module doesn't show the article id in the url so webmaster tools gives me "duplicate entries" warnings all the time. I'll find the place where to add the "id" but it never the less would be nice if you could hint me at the exact location.
If i may add a wish: please add some fields where one can add a blog of his choice and the option to choose the "status". We use four statusses: open, closed, feature and draft. The "open" articles get picked up by your module, but not our "feature" articles cause i think your module only looks for "open" articles.
Thanks'
triom
15 August 2008
Thanks for the great module! I have installed it and run into an issue... my template group is 'site' (the default for EE) and I'm using the 'include' method for removing index.php from the URLs.
This is what is in my .htaccess file:
RewriteEngine on
RewriteCond $1 ^(weblog|member|search|forums|site|P[0-9]{2,8}) [NC]
RewriteRule ^(.*)$ /index.php/$1 [L]
Because 'site' is in the .htaccess file, the sitemap.php file isn't able to be accessed properly. One fix is to rename sitemap.php to something else or to change the template group from 'site' to something else.
A preferred fix would be to edit the .htaccess to account for sitemap.php. Do you know what the .htaccess file should look like? Are you running into the same issue? I imagine this is pretty common because the default template group is called 'site' and using the 'include' method to remove index.php is also common.
Thanks for your help!
triom
19 August 2008
I've gotten it to work! Here's what my .htaccess file looks like now (I added the bottom line):
RewriteEngine on
RewriteCond $1 ^(weblog|member|search|site|P[0-9]{2,8}) [NC]
RewriteRule ^(.*)$ /index.php/$1
RewriteRule ^/index.php/sitemap.php$ sitemap.php
Danny Tam
28 August 2008
Hello,
I've recently moved halfway across the world - and unfortunately did not bring my desktop with me. Getting back into ExpressionEngine and would finally love to install your module - meant to before I moved, but settling work and school took a while!
When you get this, please kindly send the code to the email address provided with this comment - it should be the payment email address I used as well.
Thanks again for the huge help!
Danny
Ben
28 August 2008
hi danny, i resent it to you.
all the best in settling in!
Gerard
04 September 2008
Hello Ben,
I purchased the sitemap-module this afternoon, but didn't receive a confirmation e-mail with the code to download the module.
Could you please (re-)send this email?
In case you need more information, please send an email to the address provided.
Thanks very much!
Kind regards,
Gerard
Jamal
04 September 2008
If you are working on a very big site, say, 40k or so blog posts, then you may want to change something or you will end up with out of memory errors.
In mod.sitemap.php:
Comment out the $DB->query for $entries in line 96
Add the following to replace it:
$sql = "SELECT * FROM exp_weblog_titles WHERE weblog_id = '$weblog_id' AND site_id = '".$PREFS->ini('site_id')."' AND status = 'open'";
$query = mysql_query($sql, $DB->conn_id);
Then comment out the foreach loop right under it and replace it with this:
while ($entry = mysql_fetch_array($query, MYSQL_ASSOC))
Good luck,
Jamal
Ben
05 September 2008
gerrard: sent it
jamal: thanks for posting the tip
Mike
24 September 2008
Do you intend to upgrade this plugin for EE 2.0 and if so, what will be the upgrade plan...namely, will I have to purchase another license for EE 2.0 if I purchase one now or will there be a free (within some reasonable time frame of course) or fair upgrade fee.
Ben
24 September 2008
i am planning a free upgrade for EE2.0
Mike
25 September 2008
Perfect! Thanks for the quick response.
MIke
30 September 2008
Is there a way to generate the site map information and have it displayed on a template? When I click on the "view sitemap" link in the module i receive an error.
Ben
01 October 2008
yes if you point your browser to the template in which the sitemap is called, for example http://www.mysite.com/site/sitemap then you should see it.
if you are getting an error when looking at the sitemap.php file then there is a problem with the xml output of the sitemap. please email me directly with the error message you are getting.
jasmanac
10 October 2008
Could you please resend me the code because I lost it and can't update files to the newest ones?
Thanks in advance!
Ben
13 October 2008
jasmanac: please email me with the email address you originally got the code with
misu
15 October 2008
hello
i run in a problem. my urls are like this : http://test.de/weblog/comments/test
in the sitemap i see only http://test.de/test
but this url is wrong. where i can cange the url to the right path?
Ben
15 October 2008
Modules › Sitemap
misu
15 October 2008
could fix it. the path was wrong
Adam
05 November 2008
I am having a wierd issue. When I add a new weblog entry I get a message saying there was an error when trying to notify Google. Anyone have any ideas?
Ben
05 November 2008
hi adam, most likely there is an error in your xml sitemap, or there is a connection error. i would think its the former as i assume you are using a live site. try viewing the sitemap in your browser and see if it throws any errors.
IdeaLady
05 November 2008
Ben, pages that are set with an expiration date in EE continue to show up in the sitemap after the date has passed. Google can't find them in the crawl, so this creates 404 errors.
Is there a way to automatically keep expired pages from appearing in the sitemap, or do I need to manual delete the pages from EE? It is not a large number of pages, but I expire class listings once the class is over.
Thanks!
P.S. Thank you for your help last week. The sitemap module is working great now--at least until the next time I break it. ;o)
Adam
06 November 2008
Ben, thanks for quick response...I tried viewing the sitemap in my browser (www.capitaldesign.ca/sitemap.php) and it loads the site (index.php) and not the actual xml file. Is the a sign of something I did wrong in the setup?
HansL
06 November 2008
Hi
Is your module also working with 'templates as files'? I use an extern editor to create and upload my templates. Hence the templates are not stored in the database, but live on the server.
Quena
06 November 2008
HansL,
I use the "templates as files" feature too, and it has not interfered with the Sitemap module. I presume that's because the "templates as files" feature is linked to the EE's template database (thats how I read the docs at http://expressionengine.com/docs/templates/flat_file_templates.html), but if I'm wrong I hope someone here will set me straight.
HansL
08 November 2008
Thanks, Quena!
Ben
10 November 2008
hi adam, just checked your site and the sitemap is working now. not sure what you did but it seems to have fixed it.
Lidia
20 November 2008
I get this error message when I click View Rendered Template: 'This XML file does not appear to have any style information associated with it. The document tree is shown below.
any ideas as to what's causing this?
my sitemap.php variable is currently set up as 'GROUP/sitemap' (it is the default EE 'site' group renamed). I have a blank template in this Group with {exp:sitemap:get} code.
Thanks
Ben
23 November 2008
hi lidia,
can you check if the page renders correctly when you view the template directly, i.e. www.yourdomain.com/group/sitemap
if it looks right there then its probably an issue with the sitemap.php file. check that you have edited the following line in that file:
$template = 'site/sitemap';
in your case it should be:
$template = 'group/sitemap';
Adam G
25 November 2008
In Modules > Sitemap - I need to add a weblog URL in the form of:
http://www.example.com/template_group/template/{entry_id}
Currently the module only seems to output based on the url_title, but my templates use the entry ID.
Thanks for your help.
Lidia
25 November 2008
Hi Ben
Thanks for your reply. I see that the module creates an XML file only and not a clickable links sitemap for users, according the comments above. Perhaps that is why the sitemap template is not displaying links?
What I am seeing when I view the template directly at http://www.domain.com/index.php/Group/sitemap is a page displaying both weblog URL paths and the module preferences (status, frequency, priority) spanning across the page. Is this rendering incorrectly?
Thanks again,
Lidia
Ben
26 November 2008
lidia: yes it sounds like the template is renderring correctly. which leads me to believe that the issues is with the sitemap.php file (see my comment above).
adam g: you can make it output the entry_id rather than url_title by changing line 122 in mod.sitemap.php (v1.4.2) to:
Lidia
01 December 2008
Rendering incorrectly?
My sitemap.php file does contain 'groupname/templatename'. What I'm seeing when I view the sitemap template at http://www.sitedomain.com/index.php/groupname/templatename are all of the site weblogs and the module settings all on one line, spanning across the page. shouldn't this be rendering as a list or in some sort of order?
When I click View Rendered Template:
−
−
Thanks for your help.
KJ
08 December 2008
Great module/extension! I was up and running in minutes.
Daniel H
08 December 2008
Hey, just wanted to talk to you Ben about a potential bug fix I've developed for people hitting the following error:
Parse error: syntax error, unexpected T_STRING in /../system/core/core.functions.php(637) : eval()'d code on line 1
-Daniel
Ben
09 December 2008
lidia: that sounds about right. when you click on view rendered template you should see a file that is similar to the example at http://www.sitemaps.org/protocol.php#sitemapXMLExample
danielH: i haven't had any reports of this happening, can you describe when it happens and what your fix is please
Adam
10 December 2008
Nice module!
It would be great if you could also render an html version of the sitemap, in a list, for accessibility.
Rolf
18 December 2008
Hi,
I just installed your module today. Everything seems to work okay, and I can see a nice xml document when I view the sitemap.php file.
Unfortunately when I submit this to Google, I get an error returned saying that its the wrong format. From reading the threads above, I thought Google was supposed to see it as an xml document... but I have a feeling that it's not.
Here's the sitemap file: http://www.marlatt.ca/sitemap.php
Have I done something wrong?
Rolf
18 December 2008
Figures... I thought I'd re-submit the sitemap to Google right after I posted here and now everything works. Must have been a 'blip' the first time.
Sorry to bug!
Ben
18 December 2008
adam: thanks for the suggestion, maybe in the next release...
rolf: no problem, glad you got it working!
steve
05 January 2009
where's the render example? I cant buy it without see... help!!!!
Mike C
05 January 2009
Hello
I am interested in buying this extension, but maybe newbie question someone could answer..... Should I still be placing a robots.txt file on my server? and if so, does it need to point the bots to the sitemap file?
many thanks in advance
Ben
05 January 2009
steve: output is an xml sitemap, not much to see...
mike c: the sitemap is not related to the robots.txt file, but you can still have one if you like, no need to point to sitemap though.
arin
17 January 2009
hi, i'm just curious... i'm running multiple domains off one expression engine install (the old way, not using the multiple site manager) and i'd like to create a sitemap for each of those domains. is it possible to do that? (so far, i have a really nice sitemap that includes the links to *every* domain, rather than 1 sitemap per domain).
Ben
18 January 2009
i'm not sure how you've set that up but in theory it should work, as long as each weblog is for a different site (i.e. no weblog is used for more than one domain).
arin
19 January 2009
i have the multiple domains set up like this: http://expressionengine.com/wiki/Running_Multiple_Domains_or_Subdomains_or_Subsites/ and yes, each weblog belongs to it's own specific domain.
when i create the sitemap for mysite1, tho, i get a list of urls for mysite1, mysite2, mysite3, etc. so, of course, google errors out the extraneous urls. http://www.arinsattic.com/sitemap.php
it works *beautifully* other than that. is there some way in the sitemap.php file that i can make it only include the urls for the *specific* weblog (or domain)?
Ben
19 January 2009
hi arin, i'm afraid not. it works with MSM but unfortunately isn't compatible with your setup. as you say it'll work but google will spot the non-existent urls.
arin
20 January 2009
ben - ok, that's what i thought might be the case. at the moment, it's still creating a better sitemap than anything else i've tried! thanks for your help!
Mary Slater
04 February 2009
I paid and still havent received my link to download the code. How can i get that?
Matthew Callis
05 February 2009
When running this on the primary domain of a MediaTemple account you cannot cURL to the domain itself or you'll get the Apache test page. To fix this, you have to use the server IP address in place of the host in sitemap.php.
You can also rename sitemap.php to sitemap.xml and add this to your .htaccess to keep everything running smoothly if you already had a sitemap going:
AddType application/x-httpd-php .xml
Adam
05 February 2009
Great module! I'm having a little problem though. I'm using the include method to remove index.php from my url path and its interring with sitemap.php somehow. I had to add a "?" to my .htaccess file after index.php/ and I'm pretty sure thats what's causing the problem. I read on the comments above that someone else had a similar problem, but their solution did not work for me...(I think becuase of that "?") Here is what my .htaccess file looks like:
RewriteEngine on
RewriteCond $1 ^(weblog|our-work|article|catpage|embeds|reach-us|member|/flash|search|Forum_Name|site|cds|includes|services|P[0-9]{2,8}) [NC]
RewriteRule ^(.*)$ /index.php/?$1 [L]
RewriteCond %{http_host} ^capitaldesign.ca [nc]
RewriteRule ^(.*)$ http://www.capitaldesign.ca [r=301,nc]
Anyone have any ideas?
Erwin Heiser
06 February 2009
How easy/hard would it be to add the following search engines to the ping list? (it's a client request): live.com,
lycos.com
altavista.com
clusty.com
gigablast.com
Cormac
07 February 2009
Hi Ben, I'm having a similar issue with .htaccess as Adam above. No matter what combo of paths I use the sitemap is not rendered correctly in sitemap.php.
The information is in place on site/sitemap, but not in sitemap.php
http://www.coreenergy.ie/sitemap.php
http://www.coreenergy.ie/site/sitemap
I'm using the Include method to remove index.php in .htaccess
RewriteEngine On
RewriteCond $1 ^(member|includes|site|info|residential|commercial|faq|blog|about|privacypolicy|terms|contact|P[0-9]{2,8}) [NC]
RewriteRule ^(.*)$ /index.php/$1 [L]
RewriteRule ^/index.php/sitemap.php$ sitemap.php
And in sitemap.php I have:
$template = 'site/sitemap';
$sitemap_url = 'http://'.$_SERVER["HTTP_HOST"].'/index.php/'.$template;
Appreciate your help with this.
Cheers
Cormac
Ben
08 February 2009
Adam & Cormac: i think the problem might be that the site in your include list is conflicting with sitemap.php. i recommend you change the filename to xml_sitemap.php and try again.
Erwin: i have added live.com to the list (update the ext.sitemap_pinger.php file), however most of the others you mention get their search results from the major search engines already supported, so there is not much point in adding them. if you can find a ping url for them then let me know and i'll add them to the list.
Cormac
09 February 2009
Thats got it, thanks Ben.
Ben
09 February 2009
no problem, just don't forget to change sitemap.php to the new filename in the extension ext.sitemap_pinger.php
Jim Riley
14 February 2009
Hi Ben
I bought the extension back in Jan 08 and am only just getting around to installing! I have lost the licence info - please could you resend?
Jim
confused
16 February 2009
Does this work with the EE Pages Module?
I cannot tell from the description (unless I'm missing something). Anyone know? Thanks.
Ben
16 February 2009
at present this does not integrate with the pages module however it is planned for the future
Dom Stubbs
18 February 2009
Hi Ben,
I have just purchased the module with a view to setting it up for a client. One problem I'm running into is that some of their entry URLs are based on category URL titles and there appears to be no support for this built into the module. The module could be made a lot more powerful by giving access to key variables such as category_id, category_url_title, entry_id and url_title and allowing users to specify their own URL structures, as opposed to always placing the entry url_title at the end. Is anything like that forthcoming, or will I need to modify the code?
Thanks,
Dom
Ben
18 February 2009
Dom: funny that you should ask about this kind of thing, i've been working on basically the same functionality you have requested, and it should be ready in the next week or two.
Dom Stubbs
19 February 2009
That's great news, I look forward to giving it a try.
Jim Riley
21 February 2009
Ben - could you give me a hand with the final installation settings
I dont think I've quite got sitemap.php set up right, or inthe right place
Ben
23 February 2009
Jim, i replied by email
Dom
16 March 2009
Hi Ben, any news on the update? Sorry to be a pain, but it would be good to get this up and running ASAP. Thanks.
Ben
19 March 2009
just released version 1.6 which gives you full control over the structure of your urls. see the notes above.
marcel
20 March 2009
I have this error too when I visit http://www.greatnonprofits.org/sitemap.php
XML Parsing Error: no element found
Location: http://www.greatnonprofits.org/sitemap.php
Line Number 1, Column 1:
I know I'm not alone, but nobody has ever posted the solution.
Furthermore, I see a blank page whenever I visit
http://www.greatnonprofits.org/site/sitemap
I'm totally puzzled and any help would be welcome indeed.
Ben
20 March 2009
marcel, its not that a solution has never been posted, its just that the module is not set up correctly. first of all, find out why your site/sitemap template is blank. open the template and check that it contains {exp:sitemap:get} and nothing else. then go to the module settings and ensure that some weblogs or urls are included.
once you have the template set up correctly, the sitemap.php file should show the xml in the correct format.
Russ
23 March 2009
Hello,
I do not know how to change this setting? No matter what I do it remians, I want to make sure this is set to daily.... at the root domain....
http://www.domain.com/ 2009-03-23 weekly 1.0
Ben
23 March 2009
hi russ, i'm afraid its hard-coded in. i'll improve this in the next release. in the meantime you can change weekly to daily in line 69 of mod.sitemap.php to solve this
Jasper
26 March 2009
Hi,
Will this module be upgradable/work with EE 2.0 ?
Ben
27 March 2009
hi Jasper, yes the module will be upgraded to work with EE 2.0 for free.
Jerrod
30 March 2009
Any idea why I'm getting double & triple entries in the sitemap from one particular weblog?
Dom
01 April 2009
Thanks for the update, this looks like it should do the trick perfectly. Unfortunately I'm now seeing a huge number of duplicates though - 67 per entry in fact. In each of the site's weblogs. I'm going to look into it, but any pointers would be very helpful.
Dom
01 April 2009
I've fixed the duplicate entries bug by rewriting the $entries query and obtaining the category data via a secondary query. Two queries are needed as otherwise you run into big problems with weblogs/weblog entries that do not have categories assigned. I was seeing 67 entries per weblog item because I had a total of 67 entries within exp_category_posts. I'm happy to provide the updated code to anyone who needs it urgently, but I assume the next release will correct this.
Ben
02 April 2009
thanks for the heads up Dom. i have fixed this issue in version 1.6.4. it was happening for entries that had multiple categories assigned to them - thats how i overlooked it.
cheers!
Tim
15 April 2009
Hi -- I just installed the Sitemap module (on EE 1.6.7) but when I try to access the template I get the following error:
I followed the installation instructions closely -- what have I missed?
Tim
15 April 2009
Huh. Never mind. It started working all on its own a couple hours later.
Joerg Wurmitzer
03 May 2009
Hi there! - I just realised that I have lost my registration email - You couldn't please send me the registration code again!?
Thank YOU!
Fernando
08 May 2009
Greetings, would like to purchase your module.. I have the Multiple Site Manager. How does this module work with the MSM module? Since I have several sites under it, will I need to purchase a separate license for each site? Or is this module applicable to all of the sites under the MSM module?
I thank you..
Best,
Fernando
Ben
08 May 2009
hi fernando, one license per EE installation, so you will only have to buy it once for all sites in your MSM, and you will be able to have a different sitemap for each site.
mary
14 May 2009
Ben,
my client initially wanted english as the primary language but have since decided to swtch to french as the primary is there a simple way to switch that without have to fix all the hard coded links with fr/ ?
Thanks
Matt Perry
14 May 2009
Hi,
We are interested in your add-on (it looks cool) but were wondering how it scales ... I'm assuming that it dynamically renders the sitemap on each access (ie -- it does not cache) First of all, is this true? Our sitemaps are likely to be large.
If this is true, then what experience to you have with how the module scales -- ie, are there performance problems associated w/ large sitemaps? Do the queries generated use indexes, etc? Our site is relatively high traffic, and we need to avoid expensive DB hits if possible. Also I saw the note above about needing to make a modification to avoid "out of memory" errors -- is this still necessary for large sites?
Any help you can provide would be great.
Thanks
Matt Perry
Grist.org
Ben
14 May 2009
hi matt,
yes, the sitemap dynamically renders on each access, no caching is done.
in terms of scaling, i have built in some functionality for making sure that the sitemap is rendered in manageable chunks, however the module was not originally designed for very large sitemaps.
there are two options available for seperating the sitemap as you will see above. make sure you stick to google's 50,000 limit, i would recommend a max of 10,000 at a time though to ease server load.
this should be fine if your sitemap is within the limits of thousands of urls. there was a case of a site that required millions of urls - in that case this module is unsuitable and a static sitemap is much more preferable.
hope that answers your question.
Matt Perry
15 May 2009
Hey thanks for the quick response!
Mark
17 May 2009
Hi Ben,
Will this module work if am importing xml product data and never accessing the publish and edit tabs?
Thanks,
mark
Ben
18 May 2009
hi mark,
if the data is being imported into weblog entries then yes, the sitemap module will still work. the only difference is that search engines will not be pinged, but thats not a big deal as sitemaps are usually checked every couple of days.
Albert
27 May 2009
Hi Ben,
just read your answer to Makrs question above as is answers half of my issues. The other one is: What if I have a single weblog entry like www.mysite.de/index.php/templategroup/template/productname, that can´t be reached via a link on my site. Will this URL still be included in the sitemap?
Normal sitemap generators who crawl a site starting from the top will never reach this page and thus have it not included in the sitemap. Since your tool doesn´t crawl the site, but works from "within" I assume, that those "orphaned" links will still be included.
Am I right?
Thanks
Albert
Ben
27 May 2009
hi albert,
if the weblog is set to "included" in the sitemap module settings then yes, the links to the weblog entries will be included.
Tori
28 May 2009
We have installed your module but the sitemap is not working. It never finishes loading. It just sits there. This was happening whether you went to the template directly or if you went to the /sitemap.php url. As a next step I tried creating a separate template group and placed the sitemap template in it. Now I can see a jumbled bit of links when I go directly to the template but I still get the loading issue when I try to go to /sitemap.php. I have double checked my variable in the sitemap php page so I know it is correct. Also, there are no spaces or anything else in the template. I'm not sure what the problem is. Please email to discuss further and I will send you actual links.
Thanks,
Tori
Lelia Thomas
15 June 2009
I emailed you a little over a day ago, because I bought this, but have not been able to download it. When I use my PayPal email address and the code I was sent via email, I receive an error that says "Incorrect email address or code." I emailed you, requesting I receive a copy via email, if at all possible.
I hope this is seen to quickly. I rather need this module, and I did pay for it.
Lelia Thomas
17 June 2009
I'm really frustrated by this. I paid for this ($50AUD) on the 14th, and because of what appears to be a broken system, I cannot get what I paid for, three days later. I've not heard from the developer, despite these comments and an email.
Andrew
18 June 2009
Not sure if this will help but I just purchased the module and noticed there was an extra space when I copied and pasted the code. Maybe double check that.
Lelia Thomas
18 June 2009
Thanks, Andrew. Unfortunately, spaces don't seem to be the problem. I'm thinking it might be my PayPal address, which I have go to a label in Gmail, and so it uses a + symbol in it. Perhaps this is causing some confusion for the script. Still, I would think the developer would be around enough to check his email or site every now and again, to fix this. :/
Ben
18 June 2009
hı lelia,
apologies for not getting back to you sooner, i was travelling the last few days and was not able to check email. ı'll resend the code to you. sorry again if you were frustrated by this.
ben
Marc
19 June 2009
I am looking for a good sitemap module for our expression engine site. Can the sitemap generated by this module be submitted to Google webmaster tools easily?
Ben
19 June 2009
hi marc, yes its very simple, you just need to submit the url to google. it will look like thıs:
http://www.yoursite.com/sitemap.php
Lelia Thomas
23 June 2009
I think I must be doing something wrong. I've enabled everything, have the proper code in my sitemap template, and have the sitemap.php file pointing to it. The page works, but it's picking up the rest of my site's design in some bizarre way. See http://www.leliathomas.com/sitemap.php All I have in my sitemap/index file is {exp:sitemap:get}. Do you know how it's pulling the rest of my site's design, all by itself?
Lelia Thomas
23 June 2009
I should probably clarify that this isn't a page that I'm going to use throughout my site, really, so I was just planning to have a plain and basic, white-background design for it.
Ben
23 June 2009
looks like a redirect ıssue. the page should look like this:
http://www.leliathomas.com/sitemap/index/
did you make the appropriate change to your .htaccess file? you need to make sure that sıtemap.php can be read and is not redirected.
EB
24 June 2009
Hi Ben,
I think I got it, definitely operator error, thanks!
David Webb
29 June 2009
I want to reiterate the need to add certain templates that are used like static pages, plus the wiki and forums that come with EE. Thanks!
Ben
02 July 2009
hi david, thanks for the comment. static pages can be added wıth the green 'Insert New Location' button in the top right.
pixelman
15 July 2009
I use your module in a clients site
http://www.b-solutions.be
I use only 1 weblog for several levels of content. So not several weblogs for each level of content.
> http://www.b-solutions.be/hardware_software/page/{url_title}/
works fine the only problem I have is that /hardware_software/ is changing dynamically.
Do you have any variable like ' {segment_1}' that could solve my problem:
> http://www.b-solutions.be/{segment_1}/page/{url_title}/
greetings.
pixelman.
Ben
17 July 2009
hi pixelman, how about giving each level of content a category and then using {cat_url_title} to dynamically change the first segment:
http://www.b-solutions.be/{cat_url_title}/page/{url_title}/
misu
19 July 2009
i run in a little problem and get after posting an article the following error:
An error was encountered while trying to notify Live about this entry
is it possible to disable Live?
Ben
19 July 2009
What exactly is Live misu?
misu
20 July 2009
"lol" a part of your modul
here the complete message:
Google was successfully notified about this entry
Yahoo was successfully notified about this entry
Ask.com was successfully notified about this entry
Moreover was successfully notified about this entry
An error was encountered while trying to notify Live about this entry
misu
20 July 2009
and i do not know what "Live" is and i did not change anything in the module
Ben
20 July 2009
ah its Live.com. i'll look into this and post a solution
misu
20 July 2009
thxs :-)
misu
20 July 2009
and live.com is now bing.com
Adam
30 July 2009
Hi Ben,
I bought this add-on a few months back and I'd like to update to the latest version but code so I can download the latest version? If you need my full name or billing info to confirm I purchased the add-on that will be no problem at all...Please let me know. Thanks in advance!
Adam
30 July 2009
*but I don't have the code, or the email that you originally sent.
Ben
31 July 2009
hi adam, i didn't find your email address in the list of purchases. can you please send me a message (info@putyourlightson.net) from the email address you used when you bought the module, and i'll resend your code.
thanks
Bob Foster
06 August 2009
Greetings, I was also tracking down this error that come up when submitting to "Live" and found that it is now the Bing search engine apparently. To submit a Sitemap there you use:
http://www.bing.com/webmaster/ping.aspx?sitemap=www.YourWebAddress.com/sitemap.xml
with the correct sitemap URL for your site.
But it looks like Ben already knows about the issue in this module so I'll check back later. Thanks for a great module. :-)
Ben
06 August 2009
thanks bob, i'll add it soon
Albert Warnecke
14 August 2009
Hi,
I also have the message "An error was encountered while trying to notify Live about this entry".
When will this be fixed? Bing sends quite a few users to us and I´d like to have the msnbot alerted when we post new content.
I assume it´s more or less an exchange of strings in the code. Bing needs
http://www.bing.com/webmaster/ping.aspx?siteMap=[your sitemap web address]
as stated in the webmaster section of bing.
Cheers
awa
Tom
18 August 2009
Hello Ben,
I bought this add-on with paypal but i did'nt receive any mail with license... Please let me know.
Thanks.
Tom
Ben
19 August 2009
hi tom, resent it to you
Nagib
01 September 2009
Hi,
Using 1.6.4 at the moment on EE 1.6.8. How do I add our EE wiki and EE forums to this, or is that not possible?
Ben
01 September 2009
wiki and forum entries are not covered yet, it is planned for the future though i can't give a definite date yet
Jason Kingsley
14 September 2009
I cannot find the code that was sent to me so that I can download the plugin. Can you please resend me the code?
Ben
15 September 2009
hi jason, please check your spam folder in case it was accidentally put there. i'll resend if not
M
16 September 2009
Hi,
Just purchased the code. Thanks!
Unfortunately, my uris do not follow the traditional EE setup... I use the entry date like so:
/entry/{entry_date format="%Y/%m/%d"}/{url_title}/
Would it be tough to allow for that type of uri parsing?
Thanks!
M
Ben
16 September 2009
i'm afraid the entry date tag is not supported, however i'll add this in the coming days for you...
M
16 September 2009
WOW! Ben, that would be great!!!
I was just looking at your source code, and I have to say that I am very impressed! I wish I had the skills to write Extensions/Modules for EE like this.
Anyway, many thanks for the quick reply!
Of course, no rush on the code changes... Hehe, don't get me wrong -- I would love to see entry date parsing, but I would not want you to make a change your code for sake of silly old me. :D
Again, I appreciate the help! The company I work for uses EE, and I am going to have my boss purchase this code tomorrow or the next day.
Have an excellent night/day!
Cheers,
M
Ben
16 September 2009
hey thats no problem, i want this module to be useful for as many people as possible so if this helps then i'm happy to do it! i'll send you an email when i've uploaded the update
all the best,
ben
M
17 September 2009
Ben... YOU ROCK!!! Oh man, that would be sweet! Of course, no rush... Good things come to those who wait. :D
I do appreciate it. Let me know if you need some help testing or something.
Cheers!
M
Ethan
17 September 2009
Hi Ben-
I'm really confused about step #5 in the instructions:
"Upload sitemap.php to the root directory of your website and change the template variable in it"
I'm wracking my brains to figure out what exactly to change with what. I know that there are instructions right there but I'm still at a loss. Everything else is showing up... but when I click on "View Rendered Sitemap" in the Sitemap module, it just redirects me to my home page and is not a sitemap... so I'm pretty sure it's not working right now.
Any help you could give would be great.
Thanks,
Ethan
Ben
17 September 2009
hi ethan, you want to upload the sitemap.php file into the same folder that your index.php and path.php files are in, so that www.test.com/sitemap.php exists.
one other thing to note is that if you use a .htaccess file to remove the index.php from your url's then you'll need to add an exception for sitemap.php
Ethan
17 September 2009
Hi Ben-
Thanks for your quick response... just a couple of clarifying questions:
1. My website developer got rid of the index.php from my home page to where it is: www.proassisting.com/ee but couldn't figure out how to get rid of the index.php from any other page... do I still need to adjust my .htaccess file?
2. I'm still uncertain as to what I need to change in the sitemap.php file... do I need to change anything in that file or leave it as is?
3. When you write "www.test.com/sitemap.php" above, should "test" be replaced with my domain name or come out as you have it?
Sorry for all the questions... as you can tell, I'm a newbie. Thanks again for you time in helping me get this worked out.
Thanks,
Ethan
Ben
17 September 2009
1. it looks like there is a redirect in your .htaccess file as http://www.proassisting.com/ee/sitemap.php is redirecting to http://www.proassisting.com/ee/, so that needs to be fixed first.
2. open the file and look for the two lines:
$template = 'site/sitemap';
$sitemap_url = 'http://'.$_SERVER["HTTP_HOST"].'/index.php/'.$template;
the first variable, $template should be set to the sitemap template that you created in step 4. in your case $sitemap_url should be set to 'http://'.$_SERVER["HTTP_HOST"].'/ee/index.php/'.$template
3. your domain name
no problem, hope that clarifies everything
Ben
17 September 2009
ok M, i've added the {entry_date} variable so should work for you now. use simply as {entry_date}
Ethan
18 September 2009
Hi Ben-
Sorry to be a pain but still having problems... now when I try to view the rendered sitemap that the search engines will see (the link from the module), I get this error message:
Parse error: syntax error, unexpected ':' in /home7/createa3/public_html/proassisting/ee/sitemap.php on line 14
Here is what I've tried in that line:
First this: http://www.proassisting.com/ee/index.php/site/sitemap/
(which is what the address is for the sitemap template I created) and then I tried these:
http://www.proassisting.com/ee/sitemap.php
http://www.proassisting.com/sitemape.php
Still getting the same error with each try.
FYI, I added the below code to the .htaccess file which I found above from someone who said it worked for him for fixing the redirect (don't know if this is the problem):
RewriteRule ^sitemap.php$ /index.php/site/sitemap/ [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule ^(.*)$ index.php?$1 [L]
I think we're close but again, I'm a newbie... thanks again for your prompt responses.
Ethan
M
18 September 2009
Thanks a billion Ben, it is working perfectly! Loving this add-on!!! Thanks a billion. :)
Ben
18 September 2009
hi ethan, the problem is in your htaccess file, please email it to me (info@) and i'll fix it for you.
Keegan
24 September 2009
I was trying to add better meta to my ExpressionEngine v 1.6.8 but can't find seem to find out where it is so I can purchase it.
Ben
24 September 2009
this site is for the Sitemap module, but i'm sure a google search will get you there...
Jesse B.
25 September 2009
I am up to the point where I need to submit the links to google and other engines. How do I do this? Do I need to create my own sitemap with the links from your module copied into it? Any help would be appreciated as I usually have had my sitemaps automatically generated for me. Thanks,
Jesse
Ben
25 September 2009
hi jesse, if you've correctly installed the sitemap then the url that you need to submit to the search engines will be at http://www.your-domain.com/sitemap.php
David Roberts
27 September 2009
Hi Ben
I seem to have lost my code to update the Sitemap is there any way of finding it within the Sitemap php.
Thanks
Ben
30 September 2009
Hi,
When do you plan to create a sitemap for the EE discussion forum module so it lists topics? and members?(Also perhaps index members/posts?)
Ben
30 September 2009
david: no, i'll resend it to you
ben: i don't have a definite date i'm afraid so can't say for certain, but in the coming months
Chad Crowell
06 October 2009
Seems like, for the pages module, maybe you could make {pages_uri} available in the weblogs list, so that if I have a weblog called pages with all the same frequency and priority, http://www.domain.com/{pages_uri} would add them all to the map. No?
Martin Reed
13 October 2009
When I post a blog entry, I get the following error:
Warning: session_start() [function.session-start]: open(/www/XXXXX/sessiondata/sess_ts5c7527l4tbjjmnoe8dnmjbn6, O_RDWR) failed: No such file or directory (2) in /www/eh8418/public_html/XXXXX/extensions/ext.sitemap_pinger.php on line 170
(I added XXXXX to hide directory/account name)
I have checked via FTP and the php file is there. I have checked that the extension is activated, too.
Any ideas?
Justin Suissa
17 October 2009
Hi,
I am trying to use the Sitemap Module in addition to using it for Google Sitemaps to create an actual site map page.
I used the beginning template tags and now I am trying to show the link on the page not everything. Is this possible to do and how would you recommend implementing it.
Thanks.
Justin
Justin Suissa
20 October 2009
Hi,
I moved my site off my beta subdomain and updated all the path variables in EE and the module.
However, my sitemap.php won't update no matter what I try.
So http://www.liquidcomma.com/sitemap.php won't update, but if i use it on a page like http://www.liquidcomma.com/sitemap/ the URLs are correct.
I'm also confused as to how I get Google to understand sitemap.php is the new sitemap.xml file.
Thanks for any help you can provide.
Justin
ekg1
20 October 2009
Hi
Before i purchase the module is it MSM campatible and will it play nicley with LG Beta Meta if i have that installed aswell?
Thanks
Ben
20 October 2009
martin: sounds like sessions are not enabled on your server, have you had any other problems like this before with EE?
justin: the module was never intended to be used for creating a site map page, so i don't think it'll work too well, better to create it manually. open up sitemap.php and check that the template is specified correctly in there.
ekg1: yes it is MSM compatible and should play nice with LG Better Meta.
ekg1
20 October 2009
thats great, sorry about the question but do i have to create a site map template or anything?
Justin Suissa
21 October 2009
Hi,
I just checked -- in the sitemap.php the correct template is referred to, but the URLs are wrong when I access sitemap.php in a web browser.
When I use it a regular web page template within EE the URLs are correct.
Thanks.
Ben
21 October 2009
ekg1: no, a template is supplied and its just one line.
justin: when i look at http://www.liquidcomma.com/site/sitemap/ the urls are still wrong. the base url is taken from your site settings at Admin › System Preferences › General Configuration › URL to the root directory of your site. please check that it is correctly set.
Justin Suisssa
21 October 2009
Hi,
Out template is just one line, like the instructions say, and the URL in General Config is correct. Could it be .htaccess related, that's my only thought? Is there a way to send you ours to rule that out? I did try eliminating the .htaccess file, just to check, but no luck there.
E-mail me and I'd be happy to send you the file.
Thanks for all your help.
Justin Suissa
22 October 2009
Hi,
We figured out the issue, after we confirmed all references to the old subdomain had been removed and everything else was right.
The sitemap.php just wasn't refreshing itself. So we simply renamed the template and the variable in sitemap.php to map and that caused it to generate a new file.
Hope that helps someone else who encounters a similiar issue.
Jim Riley
23 October 2009
Hi ben
please could you send me my code - I need to upgrade the sitemap mod but I dont have the original download details
Jim
Adam Bell
28 October 2009
I just did my first sitemap install, set up the map but when I go to http://justautoins.com/sitemap.php I get a message 'No Input File Specified'.How do I get the sitemap to appear?
Ben
28 October 2009
hi adam, i see that the sitemap is working at http://justautoins.com/site/sitemap
so it looks like your .htaccess file has to be adjusted to allow sitemap.php to be displayed. there are lots of articles on how to do this on the EE wiki and forums.
Adam Bell
28 October 2009
Well, I tried the following in my .htaccess file:
AcceptPathInfo On
RewriteEngine On
RewriteRule ^sitemap.php$ /index.php/site/sitemap/ [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule ^(.*)$ index.php?$1 [L]
and it didn't work. I still get the same 404 error as i did without an .htaccess file at all. I did find the sitemap at '/site/sitemap/' so I know it's there. I just can't get sitemap.php to show up. In addition, I can't get any files I place on the root to show up.
Ben
29 October 2009
hmm well you shouldnt be redirecting sitemap.php to index.php/site/sitemap in your htaccess file. instead you should allow sitemap.php to be displayed, which in turn imports the content from site/sitemap.
Adam Bell
29 October 2009
OK, but how do I do that? I'm not a programmer per se so I'm a bit lost on what to do. Regular Expressions confuse me. Right now, anything on the root seems to get a 404. Try these examples:
http://www.justautoins.com/sitemap.php
http://www.justautoins.com/test.html
Ben
01 November 2009
try removing this line from your htaccess file:
RewriteRule ^sitemap.php$ /index.php/site/sitemap/ [L]
and make sure that you've uploaded the sitemap.php file to the root folder of your website, i.e. the folder where your index.php file is
mike
06 November 2009
Do you have whole sale prices?
I starting a web company with pre made EE configured for certain type of clients for the $700 with EE license budget.
I would like to include your sitemap module with all my builds and would like to see if we can work something out.
Thanks
Mike
Ben
06 November 2009
hi mike, please email me to discuss
Russ
12 November 2009
Help,
None of my entries are showing up, for the weblogs
Russ
12 November 2009
I have configured the sections, set include and daily for articles and here is my code
http://www.domain.com/articles/{url_title}/
and the site map only shows
http://www.domain.com/ 2009-11-12 weekly 1.0
I have no idea whats going on
Kevin Evans
23 November 2009
Hey I am getting an error on google sitemap using this extension.
You can see the error here:
http://www.screencast.com/users/cwmagnus/folders/Jing/media/faed7ce4-f6fb-48ed-bf26-fef701778af1
Any ideas? I am using the include method to get rid of the index.php
thanks!
Kevin
Ben
23 November 2009
Russ: if you send me the link to your sitemap then i'll see if i can help
Kevin: make sure that the url you submitted to google works and that a valid sitemap is displayed at that url
Adam
24 November 2009
ive installed the sitemap module and extension but every time i try and view the site map by clicking "view rendered site map" in expression engines module section it displays the message:
XML Parsing Error: syntax error
Location: myurl/example/sitemap.php
Line Number 1, Column 50:
-------------------------------------------------^
any ideas what it is?
cheers,
Adam
Ben
24 November 2009
hi adam, please ensure that the paths are correctly set in the sitemap.php file. then check that the sitemap template can also be accessed directly.
hope that helps.
Adam
24 November 2009
just to clarify, within sitemap.php i am changing the info in $template to the url of my file that has this code in it:
{exp:sitemap:get}
if so i have done this i have tried giving the absolute url i.e http://locahost/example/example.php and the short one but still no success i still recieve the same error about the doctype
Adam.
Ben
24 November 2009
adam, if you navigate to the url of the template do you see the output of the sitemap?
also please make sure that there is one and only one line in the sitemap template and that it is:
{exp:sitemap:get}
Adam
25 November 2009
when i navigate to the site template i just get the line of code thats inside it which is:
{exp:sitemap:get}
there are no spaces or anything else around it just that on the first line.
Adam.
Ben
25 November 2009
i mean navigate to the url where the sitemap template is rendered, so for example:
http://www.your-domain.com/site/sitemap
Martin Reed
25 November 2009
Ben - I've never had a problem with sessions before. My EE site is hosted on Engine Hosting, too - so I doubt the server configuration is the issue here?
Recap:
When I post a blog entry, I get the following error:
Warning: session_start() [function.session-start]: open(/www/XXXXX/sessiondata/sess_ts5c7527l4tbjjmnoe8dnmjbn6, O_RDWR) failed: No such file or directory (2) in /www/eh8418/public_html/XXXXX/extensions/ext.sitemap_pinger.php on line 170
(I added XXXXX to hide directory/account name)
I have checked via FTP and the php file is there. I have checked that the extension is activated, too.
Any ideas?
Ben
26 November 2009
Martin, i've added a fix for this so please download the latest version and upload ext.sitemap.php to your server (make sure Sitemap_pinger version is 1.5).
let me know if it works,
ben
Adam
26 November 2009
Ben- i navigate to where the sitemap is rendered and thats the message i get:
XML Parsing Error: syntax error
Location: http://localhost/example/eecore/sitemap
Line Number 1, Column 50:
-------------------------------------------------^
Adam.
Adam
26 November 2009
sorry this message is above the dotted line:
adam
26 November 2009
it was the doctype it wont copy and paste on here for some reason
Ben
26 November 2009
adam, can you please email me with the url of both your sitemap template and sitemap.php file and i'll see if i can figure out what the problem is
Josh
03 December 2009
I'm having the exact same issue that Adam is having. It worked fine, but stopped working on 11/26. If I go to the site/sitemap template directly, I get the valid XML. If I use sitemap.php, and view the source, I get a 404 "The requested URL /index.php/site/sitemap was not found on this server." but if I enter that URL in the browser, it comes back with the corect XML.
I'm stumped. Help.
Ben
04 December 2009
Josh, can you try changing line 16 in sitemap.php tothe following (replace your-domain.com with your own domain):
$sitemap_url = 'http://www.your-domain.com/index.php/'.$template;
Josh
04 December 2009
Ben, got it all working.
Had nothing to do with your stuff. I'm not sure how or why, but my hosts file changed and pointed the domain to the loopback address, and as a result, cURL was returning the default Apache site rather than using DNS to return the virtual sites that are available on the box.
Thanks for your support!
Ben
04 December 2009
no problem, glad you got it working!
Adam
09 December 2009
I'm having a wierd issue. Everything seems setup correctly, but when I try to access www.mydomain.com/sitemap.php it just loads forever...I can access www.mydomain.com/sitemap but not with the .php extension...Any ideas?
Ben
09 December 2009
have you made sure that the .htaccess file allows it to load? a good test is to upload a file called sitemap_test.php with just some "hello world" text in it and see if it is displayed when you navigate to the test file.
Ira
09 December 2009
Hey Ben,
Purchase the EE Heist bundle, but haven't heard from you (or ANY of the Addon devs for that matter).
Could you please look into it and send me my reg code?
Tx!
Ben
10 December 2009
hi ira, you should have been sent a license code when you purchased the ee-heist package. if you didnt then please get in touch with jack at ee-heist.com
A.F. ten Brink
12 December 2009
Since I'm using EE 2.0, I wonder when I can expect the Sitemap update?
Cheers!
Guus
Ben
15 December 2009
the update to EE 2.0 is coming before the end of the year
Chris
21 December 2009
I'm curious as to how you keep not-yet-published (ie. future date) entries from showing in the sitemap.
I've adjusted the date of the entries prior to the first save and they're still showing in the sitemap.
Is there an easy fix for this?
Thanks for a great module and I hope this is something that can be overcome.
Chris
21 December 2009
Regarding the future-date entries, I was able to make the change in the SQL to check against entry_date.
Thanks again for a fantastic module!
Ben
21 December 2009
cheers chris, i'll fix this in the next release.
Steve
04 January 2010
Is this compatible with EE 2.0 at all? I've purchased but install is not working.
Ben
04 January 2010
hi steve, no it is not compatible with EE 2.0 yet. it will be by the end of the month. email me if you would like a refund, or you can wait for the update...
Steve
08 January 2010
Thanks for the reply Ben. Its ok I can wait for the update. Just dont forget me!
Paul
09 January 2010
Morning Ben,
When rendering sitemap.php, I received the following error message.
This page contains the following errors:
error on line 1 at column 47: Space required after the Public Identifier
Thoughts would be appreciated.
Paul
12 January 2010
When you have a chance, can you respond the my comment above?
Ben
12 January 2010
hi paul, i'm not sure what the cause of that error is. could you let me know the url your are getting the error on, either here or by email, and i'll try to help. i notice that its working fine at http://www.16toads.com/sitemap.php so i'm guessing you're using it on a different domain?
cheers,
ben
Paul
12 January 2010
Problem solved (courtesy of Ben):
ensure that there are no spaces or line breaks before the {exp:sitemap:get} tag in the template
Chris
20 January 2010
Hi,
I had a couple of setup questions.
1. On step 4, is the new template supposed to be an xml template or regular "web page" template? I presume a regular web papge template, but am not sure.
2. a. When I go to the http://www.thisismydomain.com/sitemap.php page, I am not sure what is supposed to happen.
Right now it goes to my main site page. Is it supposed to generate a sitemap.xml page when you hit the php version?
b. When I to go to http://www.thisismydomain.com/sitemap/ or without the last /
I see this, in text:
http://www.thisismydomain.com/ 2010-01-20 hourly 1.0 http://www.thisismydomain.com/b/ 2010-01-20 hourly 0.9 http://www.thisismydomain.com/index.php/ 2010-01-11 weekly 0.5
Looking at the source of the page it looks like a valid sitemap though.
3. Going to sitemap.xml goes to the main page also - since there is no sitemap.xml file there, I expected that.
4. If hitting sitemap.php is supposed to generate a sitemap.xml file, it doesn't - no sitemap.xml is generated. I had always thought one
submitted the URL as sitemap.xml not just domain.com/sitemap
If it is supposed to generate the sitemap hitting sitemap.php or sitemap.xml,, I presume I need to change something in my htaccess file to make the sitemap an equivalent to sitemap.xml
Thanks for the help.
Chris
20 January 2010
Another question:
In the sitemap.php file, the lines read as follows:
// Change this to your sitemap template
$template = 'site/sitemap';
Should it look like (a) or (b) below:
(a) // Change this to your sitemap template
$template = '/www.thisismydomain.com/web/content/sitemap';
or
(b)
$template = '/www.thisismydomain.com/web/content/sitemap.xml';
Or something else? Trying to figure out the problem. ;-)
Thanks
Chris
20 January 2010
or (c) $template = '/www.thisismydomain.com/web/content/sitemap.php';
I likewise see that Google will accept sitemap.php as a valid sitemap as long as the results are returned as xml.
Chris
20 January 2010
pps. If I add sitemap.php to the htaccess file (see below), it throws an error (This page contains the following errors: error on line 1 at column 1: Document is empty Below is a rendering of the page up to the first error.).
This still works though:
http://www.thisismydomain.com/sitemap
And I can see it here:
http://www.thisismydomain.com/site/sitemap/
Here is the htaccess line:
RewriteCond $1 !^(index\.php|install\.php|names|ee-system|v1|area-codes|zip-code|directories|directory|themes|user_guide|images|css|js|SQLyogTunnel\.php|phptest\.php|xd_receiver\.htm|robots\.txt|favicon\.ico|sitemap\.php)
Ben
20 January 2010
hi chris, its really not that complicated.
don't change the sitemap.php file, just add the exception to your htaccess file as you have already done and that should be it. when you navigate to sitemap.php you should see xml code with your urls in it.
if you have problems then please email me with your domain name and i'll look into it.
ben
chris
20 January 2010
And one more question regarding this:
"$template = 'site/sitemap';"
Is this supposed to the file name path to the site or the URL path to the site?
e.g. what you would access from the web: http://www.mydomain.com/sitemap
or
what you would access if you were putting a file name,
/user/sites/domainname.com/sitemap
Ben
20 January 2010
$template should indicate the template in which the {exp:sitemap:get} line is in, and in most cases it is simply site/sitemap, so you can leave it as:
$template = 'site/sitemap';
chris
20 January 2010
Hi Ben,
I guess I'm not clear:
1. Is the template supposed to be "web page" or xml?
2. what the $template variable is supposed to look like? web url or disk file path?
3. I didn't see an email address to email you with the domain - I'd love to get it working. ;-) If you email me at the address above, I can email back. (I'm only through about 60% of the comments so far).
Thanks!
Chris
Ben
20 January 2010
1. web page
2. it should be left as is, $template = 'site/sitemap';
3. info@ the domain of this site (same as the email in your purchase receipt)
i'll email you now
chris
20 January 2010
Changing it back to this fixed it: $template = 'site/sitemap';
I was confused because it said to change it:
"// Change this to your sitemap template"
Seems to be working now!
Thanks!
Robert Scanlon
21 January 2010
Hi Ben - devo:tee is showing your add-on as EE2.0 ready - but here it doesn't look like it? I've downloaded the latest version as we have an EE2.0 dev site migration in progress and I use your excellent add-on in the 1.6x site.
Will you mail existing customers to say it is EE2.0 compatible if it isn't now?
Thanks!
Robert
cr
21 January 2010
Hi,
Right now the sitemaps show entries like the following:
http://www.whateverthedomain.com/ 2010-01-21 always
I was looking at the documentation for sitemaps and it allows you to have both date and time.
Three questions:
1. Is there a method of adding the time here?
2. Is there a method of indicating that a page should have its sitemap updated consistently? e.g. the page includes items that are updated pretty continuously (searches that are taking place in real time) so that each time the sitemap is generated there are certain pages that will definitely have changed?
3. Is there a way to set the ping update to happen automatically? (e.g. knowing that the pages will definitely have changed every hour, can we call the pinger automatically?) I presume I could do a page reload automatically on a page that included it every hour or so, but wanted to see if you saw any problems with it prior to doing so.
Thanks for the help!
chris
21 January 2010
p.s. Perhaps for items marked as "always" perhaps it could always put the current date and a time 2 minutes before or something?
TDY
22 January 2010
Any way to list categories - so rather than a specific URL to a post, a URL that points to all the posts listed in a category
I though sitename.com/weblog/{{cat_url_title} but that is not working. I am probably missing something simple
Ben
22 January 2010
Robert: yes i will, its coming before the end of the month
chris:
1. not at present but i'll add the time to the next release
2. afraid not, best you can do is use Always as the change frequency
3. it would have to be done manually (keep in mind that the google will automatically visit your site more often if it sees that your content is constantly changing, just give the dynamic page the highest priority and change frequency)
TDY: it should work, you have two open brackets there though, it should be sitename.com/weblog/{cat_url_title}
Justin Suissa
26 January 2010
I am having trouble installing the add-on in 2.01. Our old web site is going to be converted to this new one to take advantage of EE2
I copied the module to the third party folder as directed, but I do not see it on the list of Modules.
So I guess the issue is how to install it.
Thanks in advance.
Ben
26 January 2010
justin, did you upload the sitemap folder in sitemap_2_0 into the third party folder?
Robert Scanlon
27 January 2010
Thanks for the EE2.0 version Ben - much appreciated!
Robert
Lincoln
27 January 2010
Hi,
i've sent you a mail, please check.
Justin Suissa
07 February 2010
Hi Ben,
I have uploaded the entire folder itself, sitemap_2_0, into the folder /httpdocs/system/expressionengine/third_party/
I have a web page template set up with the one line, just like I had with the older version.
My path is site/sitemap
I removed the index.php since it has been removed from my htaccess file too
Not sure why the module isn't even listing on the entire list of module, so there is no choice to install it.
Any help would be greatly appreciated.
Justin
Ben
08 February 2010
justin, you need to upload the sitemap folder within the sitemap_2_0 folder, not the sitemap_2_0 folder itself
Steve
08 February 2010
Hi Ben,
I've just downloaded Sitemap Module for EE 2.0. Its giving me some weird behaviour. I have it installed etc, followed your instructions. However the Channels list in the Sitemap Module Control Panel is giving me problems.
When I make any changes to a channel's preferences (eg. url, included/excluded etc) and click "Update Channels", the channels seem to make multiple duplicates of themselves within that list. I am also unable to change a channel to "excluded" once I have selected "Included", even though the sitemap does actually exclude the items. Just seems that the 'channel status' dropdown box doesnt refresh back to "excluded".
Have I made any sense?! I'd like to send you a screenshot to show you exactly what I mean.
Kind Regards,
Stephen.
Ben
08 February 2010
hi steve, that was a bug that was causing certain channels to be duplicated that i hadn't encountered before. i've fixed it now so please donwload the latest version. you'll need to de-install and then reinstall on the modules page to remove the duplicates.
» View all comments
Leave A Comment