Swelling or lump in breast, inverted nipple, pain in breast and lumps in axilla should always be checked thoroughly. These are very common signs which can be seen in Fibroadenoma and also early stage breast cancers. Regular Mammography and biopsy is very important to assess the exact nature of disease. So we would suggest you to undergo a biopsy  and visit oncologist to know the exact nature of swelling and it's treatment plan.