Analyzing interferometric observations of strong gravitational lenses with recurrent and convolutional neural networks