Serious question, why do we give so much power to these tech firms such as Google, when really the solution is decentralization. We have some solutions for money with bitcoin, but there still doesn’t seem to be a viable alternative with a search engine that is decentralized?
Scraping the entire internet is expensive.
Of course theres decentralized search engine. If everyone was using YaCy and would run a crawl of everything that is missing in YaCy, nobody would need Google search engine, period!
New Edit:
To run YaCy less demonic (low resources device)
- sh startYACY.sh -d
Controlling cpu usage :
At the /PerformanceQueues_p.html page, you can limit some threads (light processes inside the JVM) maximum numbers (in the Thread Pool Settings table). When you are crawling, you can also control the Speed / PPM (Pages Per Minute) in the /Crawler_p.html page.
deleted by creator
I have tried running YaCy as a senior node recently. I couldn’t get the crawler to work for some reason. I’ll have to look into it again some time.
biggest problem with yacy is that is slow java, they should had done this on C or GO/RUST now a days
Java is memory hungry but certainly not slow, especially compared to Go
it is slow if you “have to” install the java JDK etc on a “clean” system just to run a java app. and we can argue about java vs go another time.
That’s plain silly.
deleted by creator
I don’t see why we can’t just have something like a blockchain based search engine where crypto is given based on how much indexing (crawling) is done. Of course this is just an idea right now. But have an incentive to people to do crawling of it through something like blockchain. This ensures that there won’t be any centralization and search result manipulation with things such as psyops (brain washing the population through search results)
deleted by creator
deleted by creator
deleted by creator
I disagree blockchain technology shouldn’t be underestimated
deleted by creator
Blockchain is not a good fit for a distributed search engine, since each node needs to store the entire chain. It’s possible that some sort of system for using a blockchain based token to incentivize participation in an IPFS like network would help provide a funding model for publishing the index, but that would just be one small component in a decentralized search engine, and not even the most interesting one.
I’m looking forward to europe opensearch foundation
Is there any result coming from that foundation yet? It looks like a paper tiger to me.
seems any from them
deleted by creator
energy consumption
Bitcoin alone draws more electricity than the whole of Netherlands now. It’s network is basically a crime against humanity at this point. And I say this as someone with a (small, tiny even) stake in it.
It’s negated all gains made by renewable energy, and for what. A “currency” that is even more centralized in the hands of few people than fiat money is.
deleted by creator
deleted by creator
Bitcoin is digital cash - this is a quite complete analogy.
Like cash, you can keep it in your possession, so you can lose it in a fire, or else you can put it in a bank.
deleted by creator
Nah there are lots of benefits, both for the society and the individual. That’s getting off topic though.
I’m just saying you have options. You can have the same anti fire security as with fiat. In fact you can do all the same things with crypto as you can do with fiat cash, if you want to.
It’s negated all gains made by renewable energy
Last time there were research it was driven by 70% of renewable energy. More than most industries.
It actually increases investment into renewable energy by making it more profitable to produce renewable energy.
Exactly my point. Wasting renewable resources on cryptomining is a crime against humanity.
You dont get it.
Much of the energy used would be thrown away wasted. The mining use that energy that otherwise would just be overproduced and thrown away and convert it into coins, thus making production of renewable energy much more profitable than it would otherwise be and thus accelerating the expansion of renewable energy.
Thus it is not a crime, it actually helps motivating building more renewable energy.
Neither you or I cant decide if it is wasting or not. Its simply our opinion.
the main issue I see with bitcoin is that so many people are investing in it and not using it for its real purpose (an alternative to actual money). The fact that the fed prints money while bitcoin is finite shows that there will be less inflation issues. Although I am not an economist
It’s a “currency” where the majority of currency got handed out to very few people very early on. It’s has a more concentrated level of wealth than the real economy has. And the energy use is a far bigger issue than all others.
It is way more distributed than wealth in the normal fiat system in which only a few owns 50% of all the wealth.
Unlike that system you are also free not to use it.
You also have the opportunity to get other coins or versions that are cheaper.
Although I know you are right, I kinda feel the whole energy consumption issue isn’t a big thing, or rather it wouldn’t be if miners would be able to use green energy for them, I don’t care if it consumes a lot of energy if it could help to create a decentralised and fungible currency.
And while BTC certainly has it flaws at least it helped to the creation of better forms of the same concept which could help to achieve that, like Monero or Pirate Chain.
would be able to use green energy for them
you do realize that producing green energy is quite energy intensive right and most of the materials are non recyclable?
Using the green energy we produce to keep a network of money for speculators running is just beyond silly.
The cryptocoin gang are so detached from reality its not even funny at this point.
deleted by creator
Proof of stake is simply giving new money for free to those who are already rich. Proof of work means that there was a verifiable cost behind each coin produced, so was not just handed out for free to the rich.
I’ve always been curious about “proof of being a human” but in not sure if any system has seriously experimented with that.
When we have an decentralised global anonymous or private ID system, it would be the best and most fair way to distibute an decentralized currency.
Thus a decentralised global anonymous ID system would probably be the most important system in humanities evolution in order to create a fair world.
How would it work then, practically? How would you prove your ID corresponds to a real human? Even better, is it possible to prove every ID corresponds to a unique human?
Why would it always be better in terms of UX? Nothing is stopping a decentralized system from having good intuitive UIs.
deleted by creator
I don’t see how that is challenging for users unless they are so lazy that they won’t even change any setting on their device regardless of how annoyed they are. If the app has a directory of instances with their bios linked it can make it easier for them.
deleted by creator
deleted by creator
deleted by creator
deleted by creator
YaCy is a decentralized search engine.
deleted by creator
pros:
- powerful customization. intuitive and fine grained.
- decentralized. huge power but not perfected.
- crawler is simple and customizable. fairly raw.
- solr/lucene benefits included from day 1.
- website that covers the basics. and forum for help.
cons:
- frequently buggy and feels heavy
- documentation. very little documentation. many good features that are difficult to discover or use.
- consumes alot of storage. not dividable.
- setup takes time
- no foolproof simplicity. and less adoption due to setup time+difficulty.
- not recognized as important and not very popular. which is a self-fulfilling prophecy.
- not too many maintainers/contributors. slow development.
alternatives:
none
there are many alternatives for more efficient small personalized search engines with medium startup time and skill level.
a crawler can be more customizable if you script it yourself. (for yacy or whatever else)To run YaCy less demonic (low resources device)
- sh startYACY.sh -d
Controlling cpu usage :
At the /PerformanceQueues_p.html page, you can limit some threads (light processes inside the JVM) maximum numbers (in the Thread Pool Settings table). When you are crawling, you can also control the Speed / PPM (Pages Per Minute) in the /Crawler_p.html page.
https://arborist.wip2p.eth.link/#!/goyacy
I’m new to YaCy and not aware of what may or may not be working but I just saw this mentioned as a “frontend for searching YaCy without having to remember which node to use”.
Anyway, I’m gonna give it a try.
What’s not working? Is it a matter of needing more crawlers as @Danrobi@lemmy.ml mentioned, or something else?
Wow, 2/3 times I tried searching through this site I got a dead (or otherwise inaccessible) node.
Yeah, basically the same for me. Sometimes it works ok. Sometimes I get infinite loading.
deleted by creator
Because it’s hard, requires A LOT of resources so that it’s way easier to ask “why is there still no decentralised search engine?” than actually implement it.
Yeah I agree, its easier said than done. Web crawling requires a lot of resources
Actually, maybe also because it requires even more resources as to build and maintain a proper decentralised software is technically harder than to do the same for a centralised search. And also because investing such resources means more donating them to the whole community rather than making profit, so those resources must not be the someone’s last penny.
