“hello i am u/NotBillGates and I agree with this message”

Thanks a lot, these are very useful and will be raised. For further feedback there is https://www.mojeek.com/about/contact and also a submit feedback button on results pages.

Bing, Google, Quant, all rate that high (#1), it’s a universal instruction page for most linux.

Just in case you didn’t know, Qwant will have that high because they use Bing’s index.

Blink and it’s GONE

*or Bing depending upon where you are

the the quick answer type stuff is coming from DDGs systems.

which doesn’t an index make, more like a fetcher for specific data

nope, it was yandex + bing, now bing: https://www.searchenginemap.com/

qwant and ecosia are both using bing, with the latter using google sometimes: https://www.searchenginemap.com/ map needs updating for that latter point

indeed so, thanks for flagging this I’ll get it raised so we can see what’s going on there

thanks a lot, if you have any search terms which didn’t work so well then that’s useful for this process

or didn’t have good enough indexes (e.g. Mojeek)

Got anymore on that? Always looking to improve

🙏 🙏 🙏

probably a sample size issue, we crawl and index everything we are able to; have seen many of this kind of site in the past, and finding them is something that other people have said they enjoy about mojeek

our preference is always to find out why the block is happening and try to convince people it should be otherwise; widespread abuse of robots.txt does no-one any good, having been crawling and indexing for so long it’s a standard that we understand and are quite fond of

we can see some of the perils and pitfalls of it too, but web builders need to be given some tools and assurances that those tools will work for them

IP already hits a wall, also better to not get a reputation as a bad bot, it’s taken a while to get known for being friendly and respecting rules, to us you should follow robots

We make money from our API, what they’re referencing is a beta ads programme which was running

Agree to disagree here, but I’ll refer to Cory Doctorow for a contextual vs behavioral/tracking ads comparison, one which is very good: https://pluralistic.net/2020/08/05/behavioral-v-contextual/#contextual-ads (applied to the media, but the general thread is relevant)

which language are we talking?

Reddit doesn’t allow us to crawl: https://www.reddit.com/robots.txt

not sure what’s happening there for you, speed is one of the things which people frequently say we do well for