Fruits/vegetables in my garden stay small as they ripen?

We live in a townhouse with a small patio garden. We moved in August of last year...inherited 5 yr old fig tree. Tree had fruit in August, but all fell off before ripening. When we got second batch in late Sept, those ripened, but most were just barely larger than a quarter (tasted fine just small). This spring I put in a jalapeno plant and a tomato plant- both are growing like weeds (though tomato plant hasn't produced fruit yet) but the first jalapeno showed up about... two months ago?? I'm not good with estimating time...anyway, I left it on the plant forever waiting for it to grow, but I picked it off today (so ripe that it had turned completely red) and it's not even 2 inches long. About two weeks ago, the plant flowered and now I have dozens of baby peppers...so I was thinking maybe it's just too hot for the fig and maybe this jalapeno was small because it was the first of the season (and the first for the plant) but, since the miniature produce thing seems to be a trend in my garden, I figured I'd throw it out there and see if anyone had an idea of what else might be causing them to be so small. Thanks in advance!