How can I get infinite maximum execution time with PHP?

php execution-time
Paul Mason picture Paul Mason · Aug 12, 2011 · Viewed 38.1k times · Source

I have a site with 2000 pages and I want to iterate through each page to generate a sitemap, using the file_get_html() function and regular expressions.

Obviously this can't be completed in one server-side execution as it will run out of time due to maximum execution time. I guess it needs to perform smaller actions, save the progress to the database and then queue the next task. Any suggestions?

Answer

Wesley van Opdorp picture Wesley van Opdorp · Aug 12, 2011

When you run it command line there will be no maximum execution time.

You can also use set_time_limit(0); for this if your provider allows manipulation.

I can't tell if your ip-address will get banned - as this depends on the security of the server you send your requests to.

Other solution

You can fetch one (or a few) page(s), and search for new URLs throughout the source code. You can then queue these in a database. Then on the next run, you process the queue.

Related questions

How to increase maximum execution time in php

I want to increase maximum execution time in php , not by changing php.ini file. I want to Increase it from my php file. Is this possible?

Read More
Maximum execution time in phpMyadmin

When I try to execute (some) queries in phpMyadmin I get this error Fatal error: Maximum execution time of 60 seconds exceeded in C:\xampp\phpmyadmin\libraries\dbi\mysql.dbi.lib.php on line 140 because I have a very large table (…

Read More
How to solve time out in phpmyadmin?

I want import huge (at least 300 mb) sql scripts via phpMyAdmin. I've tried: post_max_size = 750M upload_max_filesize = 750M max_execution_time = 300 max_input_time = 540 memory_limit = 1000M in my php.ini file, but I'm still getting timeout …

Read More