I have a dumb work related chrome thing, i’d like to make it so that when a certain notification sound plays in chromium, my computer does a few things automatically for me

Does anyone know a good way to make this happen?

I imagine it’d have to be setup like:

when chrome starts playing audio && check if that audio matches soundfile.ogg && myscript.sh, but I don’t know any good cli utilities that could get something like that done, and if there are any better ideas!

edit: to avoid X/Y issues i’ve summarized the problem in full here:

  1. I have a work program, this notifies me if I get a call or email, the work program then presents an accept/decline page, and does not proceed until I either accept, decline, or it times out.
  2. I want it to do two different things depending on if it’s a call or email
  3. It provides no notification other than the sound and an “accept” button on the page
  4. I have a chrome window open that does nothing but this, and I never use chrome for anything else
  5. I want to automatically do various things when I receive either this call or email
  6. I want it to be broadly applicable rather than a script designed for the specific website giving me the notification (so not a chrome extension). This prevents me from having to update any code in the event that the backend changes dramatically, and even if the notification sound changes, i’d just record a new sound as the activation noise.
  7. The noise is always the same, and hasn’t changed for many years, and there is a distinct noise between calls and emails
  8. They never overlap, they never play multiple times at the same time, and they never make any noises other than those two. The noises are distinct.

These factors cause me to want to run a script once the noise is recognized, only if the noise is playing in a particular app. I’m using pipewire/hyprland on arch.

My current plan for isolating the noise is to do the following:

pactl load-module module-combine-sink sink_name=‘Work’ slaves=‘easyeffects_sink’

and then set chrome exclusively to play audio on work.

Then set a script to check the sink work for audio that matches what I want. That should be simpler than the other methods i’ve seen to isolate the noise.

  • CommunistOP
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    2
    ·
    il y a 9 mois

    I actually want the sound thing because I think it would be cool for automating a lot of different things easily

    It wouldn’t be like, optimal in terms of power consumption, but an audio signal in a specific program being recognized by my computer and executing a script is generalizable and useable in many places.

      • teawrecks@sopuli.xyz
        link
        fedilink
        arrow-up
        2
        ·
        il y a 9 mois

        I would be interested in a solution to OP’s specific question. I have a friend who will play a particular annoying meme clip over discord. I would like something that can listen for that clip being played, and immediately disconnect him from the voice channel 😁.

        Doesn’t need to be perfect. Misfires are also acceptable.

      • CommunistOP
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        6
        ·
        il y a 9 mois

        Not if it’s specified to a single app

        My chrome is literally only used for this, as are my other ideas, so, as long as it’s half-decent at one specific sound per app it should work…

        in theory

              • CommunistOP
                link
                fedilink
                English
                arrow-up
                3
                ·
                il y a 9 mois

                There are two sounds it makes, they just never overlap

            • ReversalHatchery@beehaw.org
              link
              fedilink
              English
              arrow-up
              1
              ·
              il y a 9 mois

              Or at least you think so. Are you sure for example that the trigger sound can not play more than once at a time, before the first one has finished?

              And then what if the webpage updates the sound it plays?

              • CommunistOP
                link
                fedilink
                English
                arrow-up
                1
                ·
                edit-2
                il y a 9 mois

                I am completely sure that cannot happen, the noise plays once until I deal with it

                if it updates I’ll just make a new recording, but it has been the same for over 3 years

    • Nibodhika@lemmy.world
      link
      fedilink
      arrow-up
      13
      ·
      il y a 9 mois

      You’re still only explaining the Y problem, not the X one. Want to solve Y? Here you go https://people.csail.mit.edu/hubert/pyaudio/docs/ also prepare to learn a lot about streams and different audio formats, etc. You might have something usable in a few weeks or months depending on how fast you’re able to learn those.

      And just so we’re clear, you mentioned chromium, so I’m 99.9% sure that there are easier solutions if you tell is the actual problem you’re trying to solve. There’s a reason no one is providing you with a simple script that does this, i.e. no one has ever needed this, and whenever you’re in a situation where no one has ever needed something before you might be a visionary or you might be missing something that’s obvious for everyone that came before and had the same problem you did.

      • CommunistOP
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        il y a 9 mois

        here you go, if you have a better idea, pitch it:

        1. I have a work program, this notifies me if I get a call or email, the work program then presents an accept/decline page, and does not proceed until I either accept, decline, or it times out.
        2. I want it to do two different things depending on if it’s a call or email
        3. It provides no notification other than the sound and an “accept” button on the page
        4. I have a chrome window open that does nothing but this, and I never use chrome for anything else
        5. I want to automatically do various things when I receive either this call or email
        6. I want it to be broadly applicable rather than a script designed for the specific website giving me the notification (so not a chrome extension). This prevents me from having to update any code in the event that the backend changes dramatically, and even if the notification sound changes, i’d just record a new sound as the activation noise.
        7. The noise is always the same, and hasn’t changed for many years, and there is a distinct noise between calls and emails
        8. They never overlap, they never play multiple times at the same time, and they never make any noises other than those two. The noises are distinct.

        but so far my solution is to setup dejavu to listen to a sink i’ve named work and then set chrome to play on that sink, and that sink will be setup to forward to my default audio device

        https://github.com/worldveil/dejavu

        • Nibodhika@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          il y a 9 mois

          First thought was a chrome extension that detects if the button is on the screen, that should be easy. But since you don’t want that you could check how the site receives the information that you’ve got a call or an email, it’s either a periodic pull from the page, or most likely a websocket message from the server. Regardless you can use something like mitmproxy to intercept the communication and do things with it https://docs.mitmproxy.org/stable/api/mitmproxy/websocket.html this will allow you to analyze specifically what the page is receiving, so if there’s information on who’s calling or the subject of the email, or whatever it will be captured here in text which is a lot more easy to parse and analyze than audio.

      • flashgnash@lemm.ee
        link
        fedilink
        arrow-up
        1
        ·
        il y a 9 mois

        He wants a script to trigger an alarm when he gets a call so he can get away with sleeping

        • CommunistOP
          link
          fedilink
          English
          arrow-up
          1
          ·
          il y a 9 mois

          It’s actually much more malicious hahaha. But sometimes it may be used while sleeping.

    • onlinepersona@programming.dev
      link
      fedilink
      English
      arrow-up
      5
      ·
      il y a 9 mois

      Are you on linux? If you’re using pipewire (or pulseaudio), you can connect the chromium audio pipe to your audio analyzer, analyze the audio, and execute commands on a match. Here’s an example of capturing audio with pipewire. It’s in C, but there’s also a Rust crate.

      Maybe gstreamer could make it easier. Audio analysis will probably be some library that you have to search for.

      What you’re trying to do is not very straight forward, IMO.

      CC BY-NC-SA 4.0