[ip-adapter] refactor prepare_ip_adapter_image_embeds and skip load image_encoder
#7016
+769
−138