Regarding the answer, the first thing I wanted to address is that you should probably start taking some DGL (Deglycyrrhizinated Licorice) and some Aloe to help with the ulcer. DGL not only helps to soothe and settle the stomach, but it helps many people with ulcers because it helps to coat the lining of the esophagus, stomach, and the whole intestinal tract to give that nourishment. Aloe also helps to soothe any tissue it touches, so it can help soothe the whole digestive tract as well.

As far as helping the joints, there are several natural supplements that help joint health, which may remove the cause of the pain.
The most popular are Microlactin (from milk), Tart Cherries, Glucosamine (commonly from shellfish), Chondroitin, MSM, Hyaluronic Acid, Danish Rose Hips, and Bromelain.
However, you mention that it’s more in the muscles than the joints, so you may want to get a diagnosis from a holistic doctor or a specialist… if it’s the muscles, you might just be low on Magnesium, Potassium, or other electrolyte or nutrient. Good luck and I hope I helped!
References :
Health/nutrition classes, personal experience, and personal research in my role as a Product Specialist for a vitamin company