Feeding to the AI a grayscale image and a few colored dots it starting to show some results:
Plus Original colors:
Equal:
Random red and blue colors: