They use small parts of systems (named crawlers or bots) to stick to all the hyperlinks and discover new web pages (and also updates towards the pages they found before). They might serve as a touch for Google – in 2019, Google introduced that they can deal with nofollow one-way https://easyfaq.io