With modern CPU’s supposedly shipping with ‘AI cores’: How long do you think it will take for a proper opensource, privacy respecting productivity tools(Something like whatever M$ copilot is supposed to be?) to be available?

Personally, i would love to see something like ‘Passive’ OCR integrated with the display server: the ability to pause any video and just select whatever text(even handwritten) there is naturally like it was a text document without any additional hassle will be really useful
Also useful in circumventing any blocks certain websites put on articles to prevent text from being copied

Or an AI grammar checker running natively for LibreOffice.

What are some AI tools you think should be developed for desktop Linux?

  • SavvyWolf@pawb.social
    link
    fedilink
    English
    arrow-up
    27
    ·
    9 months ago

    Hasn’t OCR been around for ages now, and doesn’t need dedicated hardware? I think the main limitation is putting the infrastructure in place to allow a browser to speak to an accessibility tool (because this is an accessibility issue) and say “give me all the text on screen which is embedded in images”.

    Personally, I don’t really want any AI tools. I don’t want my system trying to preempt what I want to do and half arse it, when I could always just do it myself. I want to know exactly what my system is doing and not have it “helpfully” do or change things it thinks I might want it to.

    • Artemis_Mystique@lemmy.mlOP
      link
      fedilink
      arrow-up
      16
      arrow-down
      1
      ·
      9 months ago

      I was thinking more along the lines of something that is application agnostic i.e If it is on your display, the tool can grab it

      • qaz@lemmy.world
        link
        fedilink
        arrow-up
        3
        ·
        edit-2
        9 months ago

        I personally have a script that allows me to press a keybinding and then select some part of the display after which it copies the contents to my clipboard as text. Are you looking for something like that?

        Here it is, it should work on both Wayland and X11, but does require having spectacle and tesseract installed.

        #!/bin/bash
        
        # Written by u/qaz licensed under GPL3
        
        if ! which spectacle > /dev/null; then
            kdialog --sorry "spectacle, the required screenshotting tool, is not installed."
            exit 1
        fi
        
        if ! which tesseract > /dev/null; then
            kdialog --sorry "tesseract, the required OCR package, is not installed."
            exit 1
        fi
        
        screenshot_tempfile=$(mktemp)
        spectacle -brn -o $screenshot_tempfile
        text_tempfile=$(mktemp)
        tesseract $screenshot_tempfile $text_tempfile
        rm $screenshot_tempfile
        
        result_text=$(cat $text_tempfile.txt)
        rm $text_tempfile.txt
        
        # Copy to either X11 or Wayland clipboard
        echo $result_text | xclip -selection clipboard
        wl-copy "$result_text"
        
        notify-send -u low -t 2500 "Copied text to clipboard" "$result_text"