Describe the bug

When the LORA .safetensors file does not include metadata regarding the base model, it is assumed to be SD1, and cannot be used with any SDXL models.
I've used various other stable diffusion generators and none have ever performed any such LORA metadata validation - there should at least be a way to opt out of this behavior?
I have a few dozen LORAs from CivitAI and more than half of them have no metadata, so they are unusable in easydiffusion.

Example of the error produced:
Error: Could not load the lora model! Reason: Sorry, could not load /opt/easy-diffusion/models/lora/Girl Size_alpha1.0_rank4_noxattn_last.safetensors. You're trying to use a SD1 LoRA model with a SDXL Stable Diffusion model. They're not compatible, please use a compatible model!

To Reproduce
Use any Pony/SDXL base model, for example:
https://civitai.com/models/1348700/like-reality-pony-by-ethanar
Attempt to use a Pony/SDXL LORA that lacks metadata, for example:
https://civitai.com/models/489243?modelVersionId=544022

Expected behavior
Only block LORA usage if it has metadata to indicate that it's not compatible. When no metadata is present, at most a warning should be output, or there should be a way to opt out of the errors/warnings.

Desktop (please complete the following information):

• OS: TrueNAS Scale
• Browser: Chrome
• Version: EasyDiffusion v3.0.9c