The get random rows by value appears to be returning rows in the same order every time, i have a test database set up with different messages in one column and a static value in another which is the same in every row, when filtering by this value the order is the exact same every time
Sorry about that, this should be fixed now. There were some issues with the random selection logic.
The block now identifies all rows and selects a random assortment from the matching rows. If fewer rows match than are requested, it provides a shuffled list of all the matching rows.
Please test it out and make sure this works as expected with your dataset.
Just confirmed it to be working now, thanks magic!