Web pages in separate repo
#18
Yes... it's like the 5-second-rule where all the bacteria is held up for 5 seconds by the major bacteria saying: "Burrgrgr.. we have to ... burggrg ... wait 5 ....burggrg ... seconds .. bugrgr..." before they start trying to infect what you just dropped on the floorBig Grin

I just researched a bit. In fact, Github has it's own Robots.txt for the whole webpage and other mechanisms for rejecting bots.
Reply
Thanks given by:


Messages In This Thread
Web pages in separate repo - by xoft - 02-09-2015, 08:38 AM
RE: Web pages in separate repo - by worktycho - 02-09-2015, 09:24 AM
RE: Web pages in separate repo - by xoft - 02-09-2015, 04:45 PM
RE: Web pages in separate repo - by bearbin - 02-09-2015, 05:21 PM
RE: Web pages in separate repo - by xoft - 02-09-2015, 05:52 PM
RE: Web pages in separate repo - by worktycho - 02-09-2015, 06:20 PM
RE: Web pages in separate repo - by xoft - 02-09-2015, 07:36 PM
RE: Web pages in separate repo - by xoft - 02-13-2015, 02:31 AM
RE: Web pages in separate repo - by Creaprog - 02-15-2015, 07:34 AM
RE: Web pages in separate repo - by sphinxc0re - 02-15-2015, 09:55 AM
RE: Web pages in separate repo - by xoft - 02-15-2015, 10:25 AM
RE: Web pages in separate repo - by Creaprog - 02-15-2015, 07:51 PM
RE: Web pages in separate repo - by xoft - 02-15-2015, 09:20 PM
RE: Web pages in separate repo - by Creaprog - 02-15-2015, 09:22 PM
RE: Web pages in separate repo - by xoft - 02-15-2015, 10:13 PM
RE: Web pages in separate repo - by sphinxc0re - 02-15-2015, 11:47 PM
RE: Web pages in separate repo - by xoft - 02-15-2015, 11:53 PM
RE: Web pages in separate repo - by sphinxc0re - 02-16-2015, 02:17 AM
RE: Web pages in separate repo - by xoft - 02-22-2015, 09:06 PM
RE: Web pages in separate repo - by NiLSPACE - 03-04-2015, 07:05 AM
RE: Web pages in separate repo - by sphinxc0re - 03-04-2015, 07:09 AM
RE: Web pages in separate repo - by worktycho - 03-04-2015, 10:02 AM
RE: Web pages in separate repo - by bearbin - 03-06-2015, 07:26 AM
RE: Web pages in separate repo - by sphinxc0re - 03-06-2015, 08:45 AM



Users browsing this thread: 5 Guest(s)