[HN Gopher] Show HN: Linkwarden - An open source collaborative b...
___________________________________________________________________
 
Show HN: Linkwarden - An open source collaborative bookmark manager
 
Hey there HN! Meet Linkwarden, a fully self-hostable, open-source
collaborative bookmark manager to collect, organize and archive
webpages.  Please also visit/star our GitHub repo [1].  Linkwarden
was built using TypeScript and NextJS, backed by a PostgreSQL
database for the lighter-weight data. The rest of the data can be
chosen either to be stored on the filesystem, or stored on the
cloud on Digital Ocean Space/AWS S3, the reason for the cloud
storage solution was for the Cloud offering [2], we realized that
the preserved webpages (archives) take up space pretty quickly and
S3 was much more efficient for this task. On the front-end we used
TailwindCSS for styling and Zustand for state management.  You
could either use our Cloud offering (with 14-day free trial) to
directly support this project and experience Linkwarden, or you
could self-host it on your own machine and have maximum
flexibility.  Feel free if you had any questions, we'll do our best
to answer it.  [1]: https://github.com/linkwarden/linkwarden  [2]:
https://cloud.linkwarden.app/register - Hosted in Digital Ocean's
datacenter located here in Toronto, ON.
 
Author : DaniDaniel5005
Score  : 206 points
Date   : 2023-07-31 13:41 UTC (9 hours ago)
 
web link (linkwarden.app)
w3m dump (linkwarden.app)
 
| kornhole wrote:
| This looks slick. Because archive.org is getting a little
| problematic by not allowing more sites to be archived,
| decentralized archiving is becoming more important. I have been
| using archive box on my server. It does not have the
| collaboration features, but that is what my fediverse instances
| and other collaboration tools provide.
 
  | __jonas wrote:
  | > Because archive.org is getting a little problematic by not
  | allowing more sites to be archived
  | 
  | I haven't heard anything about this, could you elaborate or
  | link to some article?
 
    | kornhole wrote:
    | I am sorry that details escape my memory at this point, but I
    | have seen a couple instances recently where journalists tried
    | to archive news stories and were served a response that
    | someone has barred articles from this site from being
    | archived. There is also no guarantee that something once
    | archived there will not be removed when they are put under
    | pressure or terms of service change.
 
      | lexlash wrote:
      | So at one point the answer was robots.txt and now it's not:
      | https://blog.archive.org/2017/04/17/robots-txt-meant-for-
      | sea... - that information appears to be current - email
      | info@archive.org and request removal is the process, which
      | some "reputation management" firms talk about. Weirdly I
      | can't find much info.
      | 
      | Furthermore, I don't think archive.org tries to
      | hide/obfuscate their user agent so it's relatively easy to
      | block them - I know that it's possible to manually upload
      | stuff to archive.org, and there are other sources
      | (partnerships with Cloudflare and Brave, at a minimum) but
      | that's not as easy as the Wayback Machine.
 
| RevoGen wrote:
| Are there full-text-search capabilities?
 
  | DaniDaniel5005 wrote:
  | If by full-text-search, you mean the website contents, not
  | really.
  | 
  | But if you mean, searching the link details, yep.
 
    | keepamovin wrote:
    | If you want full-text-search with archiving check out my
    | project, DiskerNet. https://github.com/dosyago/DiskerNet -->
    | also well done on LinkWarden! Looks like a great product! :)
 
| swozey wrote:
| This looks really nice, great work. I'll definitely give it a
| try.
| 
| Have you considered a free tier where you could monetize it maybe
| via sponsorships/ads with the goal to have a social aspect?
| 
| I'm a huge fan of Githubs social trending/explore/lists/topics
| section for finding new tools for specific things that I work on,
| rust, go, aws, etc. for myself and my teams. Also things like
| dev.to, daily.dev, etc but they're not really as useful as I
| thought they'd be. You can see an example of the Lists I've
| created here https://github.com/mikejk8s?tab=stars - I wind up
| putting these lists into a team notion doc right now.
| 
| There's those "Awesome-XXYZ" lists but I don't think they're the
| best way to do this at all. They also wind up very out of date.
| My Github lists aren't collaborative, I can't give people a way
| to contribute to them and as far as I know they're not something
| you can search globally to find if someone has some interesting
| lists.
| 
| It's quite a bit different than what you're doing here but what
| I've been hoping to find was some sort of technology Looking
| Glass/aggregator where I could click a topic/Collection, say
| Rust, and see rss feeds, blogs, curated and very well organized
| bookmarks, hashtags of other related lists, etc in a
| collaborative manner with lots of contributors.
| 
| I was sort-of beginning to do this via a published notion domain
| and treating it like a wiki.. https://mrj84.notion.site/Go-
| Wiki-c637ff57e00046bfbe22fb2562... - that's the closest I've been
| able to brain storm as something remotely near what I'm aiming
| for.
| 
| Sorry for the long post, maybe it'll give you some ideas or maybe
| someone has some ideas for me.
 
| janvdberg wrote:
| Not to diminish the effort here, but I just want to point out (as
| someone who has tried lots of bookmark managers) that Floccus is
| everything I want from a bookmark manager (effortless sync across
| devices and just using the bookmark manager in your browser).
| 
| I am pointing this out, because I wish someone would have pointed
| it out to me.
| 
| https://j11g.com/2023/03/04/floccus-is-the-bookmark-manager-...
 
  | freedomben wrote:
  | Thank you! This is exactly what I needed, and what I've been
  | looking for for years! Open source, lightweight, and stable.
 
    | attentive wrote:
    | xBrowserSync is another one.
    | 
    | You can use https://github.com/ishani/xSyn for self-hosting.
 
  | slivanes wrote:
  | Another reason why Safari shouldn't be considered a user
  | friendly browser.
 
    | dewey wrote:
    | Which reason are you referring to?
 
      | slivanes wrote:
      | The fact that you can't use this extension (amongst many
      | others) with Safari - therefore Safari on MacOS and
      | iOS/iPadOS cannot benefit from this type of sharing. Walled
      | garden strikes again.
      | 
      | I'm not saying that Safari is a bad browser, but artificial
      | limitations imposed by Apple on the browser and the OS is
      | quite frustrating for me.
 
        | dewey wrote:
        | Safari supports the same extension standard as the other
        | browsers, they even have a tool to convert extensions
        | into the Safari format. All the bookmarks are also in an
        | sqlite database which you can access, or export them as a
        | file, this is not a case of a wallet garden.
        | 
        | I know because I did just that with my Firefox and Chrome
        | extensions. The only thing that's keeping developers from
        | doing that is that you have to pay the developer fee to
        | publish the extension app, on top of the regular
        | differences between the browsers that you have to take
        | care of if you are building an extension.
        | 
        | https://developer.apple.com/documentation/safariservices/
        | saf...
 
        | attentive wrote:
        | That's all great but neither this nor
        | www.xbrowsersync.org supports Safari.
        | 
        | That's the reason I don't use Safari beyond random
        | superficial browsing.
        | 
        | Here is what xBrowserSync has to say about it:
        | 
        | "Will xBrowserSync support Safari?
        | 
        | No and it is extremely unlikely this will ever happen due
        | to Apple moving away from the WebExtensions API and
        | forcing developers to purchase Apple hardware and pay
        | $99/year to develop on their platform."
 
    | crossroadsguy wrote:
    | People who consider Safari a friendly browser do not look
    | before iCloud and do not look after iCloud. No matter how it
    | behaves/performs. That's how Apple ecosystem rolls. And the
    | ones who do not consider it a user friendly browser do not
    | use it.
 
      | tomcam wrote:
      | I'm open to an answer to GP's question but this wasn't one
 
    | neura wrote:
    | Is this simply because the bookmark manager linked (Floccus)
    | is not available for Safari?
    | 
    | Or better yet, can you elaborate on how any of the content up
    | the chain from your comment that shows why Safari shouldn't
    | be considered a user friendly browser?
 
  | saulpw wrote:
  | "collaborative" is the key feature that Floccus and all other
  | "syncing" bookmark managers are missing.
 
  | danShumway wrote:
  | Genuine question, not trying to bash the project -- the link
  | here seems to really stress that floccus is just for syncing,
  | but can't you just use Firefox Sync for that?
  | 
  | I already have the ability to send my tabs across devices or
  | sync bookmarks, it's built right into Firefox. The UI could be
  | better, but it doesn't look like Floccus changes the browser
  | UI, which is my primary complaint with Firefox bookmarks.
  | 
  | I'm not sure what I'm missing.
 
  | neontomo wrote:
  | Thank you, seems like what I wanted.
 
  | awestroke wrote:
  | Missing features: a good UI for managing and organising
  | bookmarks, automatically archiving bookmarks in case they go
  | offline
 
  | lannisterstark wrote:
  | eeeeh.
  | 
  | Shiori looks like it'd work infinitely better compared to
  | floccus. It has an extension, tags, and everything is stored in
  | a central repository you can visit from web (or server itself)
  | any time you want. It also archives your bookmarks. It has been
  | working flawlessly for me for a couple of years now.
  | 
  | https://github.com/go-shiori
 
    | attentive wrote:
    | That looks like a web app, not an actual browser bookmark
    | sync.
    | 
    | Apples and oranges.
    | 
    | There is a value in using native browser bookmarks and
    | syncing them cross browsers/OS's.
 
      | lannisterstark wrote:
      | >There is a value in using native browser bookmarks and
      | syncing them cross browsers/OS's.
      | 
      | Don't most browsers do this automatically WITHOUT a third
      | party app? Firefox and Chrome both sync bookmarks across
      | devices. What is the usecase for a third party bookmark
      | syncer in that case?
      | 
      | Shiori acts both as an archiver as well as bookmark saver.
      | My bookmarks are ...cluttered otherwise. I have a OneTab
      | page with over 37000 'tabs' saved.
 
  | gooob wrote:
  | doesn't look like i can use my own server with floccus
 
    | johnnyworker wrote:
    | If you have a WebDAV server, you can use that.
    | 
    | I use several browser profiles (stuff like social,
    | entertainment, dev), and now I can put the usual sites I
    | visit with each of those in the top level of the their
    | bookmark bar directly, but also have a single folder for the
    | ones I want to share between all of them, yay! I am very
    | happy right now. Thanks GP.
 
  | hk1337 wrote:
  | I ended up just creating a page in Notion and imported a CSV
  | file.
 
| uzername wrote:
| Hey, this looks great!
| 
| In your readme, in the "A bit of history", it should be `has many
| fewer features`
| 
| On a more technical note, I wondered if you have any stories
| working with Prisma and Next? It works but every ORM has its pros
| and cons. My annecdote with the two is on a project recently, I
| had issues bundling the appropriate prisma packages during a Next
| standalone mode build.
 
  | DaniDaniel5005 wrote:
  | Prisma is great and I definitely recommend it to anyone who's
  | either starting out or on a more advanced level.
 
| ecliptik wrote:
| I've used Raindrop[1] for the last few years and it works well -
| cross device support, archived pages, and tags/folders.
| 
| Going to check out Linkwarden since I really like the idea of
| being able to self-host something similar since Raindrop could
| one day disappear (#googlereaderneverforget).
| 
| A feature Raindrop has is it can export bookmarks to a standard
| xml file, which I then have a script that automatically adds them
| to Archivebox[2] for a local copy and to add them to
| archive.org[3].
| 
| Does Linkwarden, have a feature to automatically submit a
| bookmark to archive.org along with the local copy? That would
| greatly reduce this setup and have it all in one tool.
| 
| 1. https://raindrop.io/
| 
| 2. https://archivebox.io/
| 
| 3. https://ecliptik.com/bookmarking-with-raindrop/
 
  | dewey wrote:
  | How has your experience with archivebox after running it for a
  | while? After trying to set it up multiple times I gave it
  | another try a few days ago and it always feels like it's doing
  | too much and is therefore very sluggish and buggy.
  | 
  | I was looking for alternatives but couldn't really find
  | something great with a decent UI and full-text search.
 
    | ecliptik wrote:
    | It isn't horrible. I have it running in a docker-compose
    | stack and after initial setup I haven't really thought about
    | it other than checking the Raindrop script I have is still
    | populating it.
    | 
    | I don't really use it interactively, it's more to have a
    | "backup" of websites I find useful after finding some I used
    | to reference for years disappeared and were never added to
    | archive.org or occasionally sending the Readability/PDF
    | versions to my Kindle.
    | 
    | I also setup YaCY[1] at one point with the idea of having my
    | own local personal search engine for the archived sites, but
    | I ended up never using it.
    | 
    | 1. https://github.com/yacy
 
      | artisin wrote:
      | Similar story, getting ArchiveBox setup and running was a
      | breeze, but everything after that was kinda rough. For one,
      | ArchiveBox doesn't have a proper API, so I had to rig one
      | up with Puppeteer. And then there's YaCY. On paper, it
      | seemed like the dream tool for indexing and making a
      | searchable bookmark collection. But in reality, it was a
      | whole lot of work followed by a whole lot of
      | disappointment.
 
    | Tomte wrote:
    | I've tried Archivebox (using docker compose) several times,
    | and every single time it just stops.
    | 
    | I import around 3k bookmarks, it starts archiving them.
    | Immediately some archival methods fail (usually screenshot
    | and pdf), and after archiving a few hundred bookmarks it
    | never continues to archive the rest. I've let it sit and do
    | its thing for several days, it never manages to get through
    | all of them (or even a sizable minority).
    | 
    | Different machines, different filesystems, different
    | networks. No idea what's wrong.
 
      | dewey wrote:
      | I'm glad to read that as it confirms my experiences too.
      | Seeing that it is also not that actively maintained I even
      | started writing a similar thing myself as I really only
      | need a small subset of the functionality.
 
  | DaniDaniel5005 wrote:
  | Being able to bookmark a Link to archive.org was actually
  | something we wanted to do earlier, but we had to do it a opt-in
  | solution per each link since there might be a website that you
  | don't want to archive for the public and instead only keep it
  | to yourself.
  | 
  | But note that it _is_ on the roadmap (but not top priority).
 
| 10000truths wrote:
| Any relation to Bitwarden, or just a happenstance similarity in
| names?
 
  | codegladiator wrote:
  | It is a Linkedin for Bitwarden.
 
    | rounakdatta wrote:
    | No please no. We have one LinkedIn, and that's enough pain to
    | humanity.
 
  | DaniDaniel5005 wrote:
  | No we're not related to Bitwarden, we both just have a nice
  | name and are opensource :)
 
| pratio wrote:
| I'll definitely give it a short this weekend. Are there any plans
| to support different authentication methods? Like LDAP, OAuth2
| etc?
| 
| I'm using linkding at the moment
| https://github.com/sissbruecker/linkding which also has a browser
| addon, the only missing thing is some form central user auth but
| we're using it as it is.
 
  | squiggy22 wrote:
  | If its on nextjs I've a feeling there are auth providers
  | kicking about to implement sso at least.
 
    | DaniDaniel5005 wrote:
    | Absolutely, the authentication is being handled by next-auth
    | so there are lots of providers that can be added in the
    | future.
 
  | DaniDaniel5005 wrote:
  | Currently the only authentication methods are using plain
  | username/password as default.
  | 
  | And if the extra environment variables are set properly, you
  | could hook it up using the email provider, taking care of the
  | confirmation emails and one time links.
 
  | jhot wrote:
  | Linkding does support header auth if your provider supports
  | that (I run authelia backed by ldap).
 
| pacomerh wrote:
| Cool project, quick design feedback, in 'Exploring the use cases'
| the left column is too narrow? https://ibb.co/f4Q5mnB
 
| vsviridov wrote:
| Oof, any time I see next/prisma I already know that my tiny VPS
| will likely choke building this... So yeah, self-hostable, but
| not for everyone.
| 
| Got burned with this by cal.com self-hosted version:
| https://blog.vasi.li/cal-com-is-making-me-lose-faith-in-the-...
 
  | FireInsight wrote:
  | I'm making a similar thing with SvelteKit and Kysely so we'll
  | see how that turns out.
 
  | thelazyone wrote:
  | Heh. Not a fan of js apps (npm or not), but your article was
  | enjoyable to read.
 
    | vsviridov wrote:
    | Thank you.
 
  | adr1an wrote:
  | Same. I don't think I need the collaboration aspect of this
  | app, so I will keep being a happy user of linkding, see:
  | https://news.ycombinator.com/item?id=21872488
 
  | sodimel wrote:
  | Here's a (my own) lightweight alternative, built using django &
  | no javascript: https://gitlab.com/sodimel/share-links
  | 
  | It allows you to store links (title & language of the page, a
  | pdf of the page, assign tags, to include them in collections),
  | it has a very simple (moderated) comment system, set status of
  | the link (online: direct link, offline: replace link by a
  | webarchive one) a lightweight ui (remember: no js), multi-
  | accounts (permissions), translations, some rudimentary stats
  | and some other things (access a random page!).
  | 
  | See my own instance for an example with thousands of links:
  | https://links.l3m.in/
 
  | awestroke wrote:
  | Build it on your own computer, rsync the result to your vps
 
  | DaniDaniel5005 wrote:
  | Actually Linkwarden was tested on machine with only 2GB of
  | memory and it ran pretty smoothly.
 
| qwerty456127 wrote:
| Can it import a list of URLs and aut-tag them using some API or
| pre-trained ML? If yes, I bloody want it! No matter the price.
 
| freedomben wrote:
| This looks really neat! Can you share more about the project?
| Such as:
| 
| 1. What is the driving vision behind this project? For example is
| this just scratching a personal itch with hopes it helps others,
| or is the hope to expand this into a product or company in the
| future?
| 
| 2. Is the goal to monetize somehow in the future? If so, what
| sort of monetization strategies are being considered? For
| example, "open core", "paid hosting" (what happens to self-
| hosted?)
 
  | DaniDaniel5005 wrote:
  | Great question, Linkwarden was initially a personal project but
  | then we decided to scale it up into a fully fledged product.
  | Regarding monetization, we already included the paid hosting
  | plan for the users who don't want to self-host, but the self-
  | hosted option will remain free forever and will always be
  | supported alongside the paid hosting.
 
| efff wrote:
| When will docker version arrive?
 
| stavros wrote:
| Just a bit of advice: You wrote a sentence about what the service
| does, and a large paragraph on what it was built on. When you're
| pitching your service, tell people what's different about your
| service, why it's better, why they'll want to use it, etc.
| 
| I understand that HN tends to be more technical, but the
| technical details can be a single link. Right now, all I know
| about your project is that it's a bookmark manager and S3 is
| better for storing files than the filesystem.
| 
| Good luck!
 
| j45 wrote:
| Looks really clean.
| 
| A few questions:
| 
| - It's not clear if this saves highlight in Ng and annotations
| (notes about the highlights). More than saving a bookmark we
| think about a sentence that can be searchable.
| 
| - Is there any plan to save the entire webpage as text (to
| maintain the annotations in it) in addition to pdf and
| screenshot?
| 
| One product I am overly dependant on is Diigo - I would love a
| replacement even if it was self hosted.
 
  | DaniDaniel5005 wrote:
  | Saving webpages as text was actually something we wanted to do
  | before launch but just went for the "MVP" for now.
  | 
  | So yeah we're definitely bringing more archive formats.
 
| [deleted]
 
| slushh wrote:
| >Easily share curated collections with the public
| 
| Do you have a page that shows the most popular collections?
 
| bachmeier wrote:
| To save anyone else the clicks, the pricing is $4/month for
| unlimited links. Currently, no export functionality.
 
| burkesquires wrote:
| I have saved this to my bookmark manager! :-)
 
| andrewrothman wrote:
| I like to save the best / most interesting links I come across as
| I browse the web. It can come in handy to pull up a blog post I
| read a while ago or remember some new sass product or developer
| tool I wanted to check out. I'm using https://raindrop.io now
| which works great for this.
| 
| When I looked into it I was surprised that browsers don't have
| this kind of bookmark management built-in. I'd be very happy with
| two small additions to browsers: (1) display by / sort by date
| added and (2) a small separate freeform text box for notes (so I
| can describe why I saved the link).
| 
| (Optionally it could be nice if browsers adopted some standard
| sync mechanism for bookmarks, maybe based on WebDAV like the
| Floccus extension).
| 
| Then again, these dedicated external bookmark managers do have
| nice features like tags, search, and offline downloads or page
| screenshots. Those are all great!
| 
| Linkwarden looks like a nice product. Looks like it would tick
| all the boxes for my use-case and the design is pleasant. I like
| that it's open source and has a fair price for the hosted
| offering. Maybe I'll give it a try!
 
| trinsic2 wrote:
| Where's the documentation? I get page not found eror
 
___________________________________________________________________
(page generated 2023-07-31 23:01 UTC)