Korea-Japan Correlation Center

1. Daejeon Correlator

Figure 1 shows the conceptual block diagram of KJCC. There are several VLBI data playbacks which will be used in our combined VLBI network, such as Mark5B, VERA2000, OCTADISK and optical fiber which shall be connected in near future. Some of them have the VSI-H compatible interface, but the others take the different interface for the data transmission. And they have also their own maximum data recording/playing back rates respectively. To absorb all of these differences and in homogeneity among these existing VLBI data playback systems, the Raw VLBI Data Buffer (RVDB) was introduced, which is a big data server with many large RAID disks and several kind of VLBI data interfaces. The VLBI Correlation Subsystem (VCS) shall receive the VLBI data from the RVDB system, shall calculate the correlation between the every possible pairs of data inputs with proper control parameters given from the monitor and control operation computer, and then shall dump the correlation results into the data archive system. Data archive system, is also a kind of data server, which is used to capture the correlated data output from the VCS and to save them as a structured file system. Finally there is also the correlator control and operation software for overall system.

Block diagram of Daejeon Correlator
Figure 1. Block diagram of Daejeon Correlator.

1.1 Playback System

KVN is now using the Mark5B system for recording and playback the observed data. KASI participated in Mark5B development with Haystack Observatory as a member of international consortium. It can support the VSI compatible and RAID-based HDD storage system. Recording and playing back speed is 1024 Mbps. DIR2000 is widely used in VERA for recording and playback with 1024 Mbps. Recently the manufacturer of DIR2000 had been stopped to manufacture, so NAOJ developed new playing back system named VERA2000, which is modified by DIR1000H system for only supporting playing back.

1.2 RVDB system

RVDB system, which is developed by NAOJ, consists of Data Input Output (DIO)(currently named OCTAVIA), 10 GbE switch, and Disk Data Buffer (DDB)(currently named OCTADDB). It is able to record the data with maximum 2048 Mbps, and can play back the observed data to the correlator with nominal 2048 Mbps. So, it has a function such as 2048 Mbps recorder and playback at the same time. As shown in Figure 1, the different types of playback systems are used in KJCC. So, the purpose of the RVDB system is that it is able to adjust the data format and easily synchronize the data during playback and maintain the buffering between recorder speed and correlation speed.

1.3 VLBI Correlation Subsystem

The main specification of VCS is described in Table 1. The VCS has a capability to process the total 120 cross-correlation and 16 auto-correlation intended for maximum 16 stations, maximum 8192 Mbps (4-streams x 1 Gsps/2-bit/64 MHz clock) input data rates per station. The design architecture for correlator is FX-based and it will use the variable length of FFT (Fast Fourier Transform) to maintain the 0.05 km/sec resolution of velocity at 22 GHz. The maximum delay is +-36,000 km and maximum fringe tracking is 1.075 kHz. The number of frequency channel per correlation output is 8,192.
Table 1. Specification of VCS.
# of antennas 16
# of inputs/antenna 4 bands(4Fx1P, 2Fx2P, 1Fx2P+2Fx1P)
Max. # of corr./input 120 cross + 16 auto
Sub-array 2 case(12+4, 8+8)
Bandwidth 512 MHz
Sampling, Digitization 1 Gsps by 2bit/sample
Maximum data rate/antenna 2 Gbps VSI-H(32parallels, 64 MHz clock
Maximum delay compensation +-36,000km
Maximum fringe tracking 1.075 kHz
Design architecture FX-type with FPGA
FFT word length 16+16 bits fixed point for real, imaginary
Inegration time 25.6 msec~10.24 sec
Data output channels 8192 channels
Data output rate Maximum 1.4GB/sec at 25.6msec integration time

1.4 Correlated VLBI Data Buffer(CVDB)(old name : Data Archive System)

The basic architecture is a CPU cluster connected with infiniband. For KVN and KJJVN, the first phase data archive system with about 119TB capacity has been implemented. It has 4 10 Gbit Ethernet input port to connect with VCS output and 1 10 GbE Ethernet port is connected with data file system for sharing the disk with each other. We have a plan to increase the system capacity for support the EAVN in near future. CODA file system is used in data archive system for making the file system from correlated raw data, which is revised with Ccoda 2.0 library used in Mitaka FX correlator with some modification. New CODA files system based on the Ccoda 2.1 library was installed. Figure 2 shows the view of Daejeon Correlator installed at Korea-Japan Correlation Center (KJCC) located in KASI, Daejeon, Korea.
Korea-Japan Correlation Center
Figure 2. Daejeon Correlator installed at Korea-Japan Correlation Center.

2. Correlation Processing

2.1 Correlation mode and Integration time

KJCC is currently able to support the following correlation mode.
-C5 (16 MHz BW, 16stream), Integration time : 1.6384sec @ correlation
KJCC will support the following correlation mode until 2013.
-C2 (128 MHz BW, 2stream), Integration time : 1.6384sec @ correlation
-C1 (256 MHz BW, 1stream)
-W1 (512 MHz BW, 4port)

2.2 CODA/FITS

KJCC will basically support following frequency channel for preparing FITS file. -Basic output channel of correlator : 8192 frequency channel -Continuum : 128 frequency channel(64 channel integration) -Spectral line : 512 frequency channel(16channel integration)

2.3 FITS delivery

KJCC will deliver FITS file to PI by using FTP server or USB memory or mobile disk.

2.4 Archiving policy

KJCC will organize the archiving policy for observation data, CODA and FITS file as below.
-Observation data : basically 2 months, and then it will be released.
-CODA : if correlated data will be used for astrometry or geodesy, it will be permanently stored at CODA server. Otherwise, the correlated raw data and CODA file system will be deleted after receiving the response from PI.
-FITS : it will be permanently archived at Archiving server.

2.5 Correlation expected time

Correlation processing will be currently took about 2 weeks for preparing 1st version of FITS. However KJCC will do our best to make correlation as fast as possible to deliver FITS file to PI.

3. Performance of KJCC(Continuum/Spectral-line)

3.1 Data Analysis(@AIPS)

In order to verify the performance of Daejeon correlator, data analysis was conducted to understand the related problems and to attempt to solve them. For the comparison KJCC, Mitaka FX and DiFX correlator were used for data correlation. Some problems were found by comparing by each analysis result. Observation experiments were listed in Table 2. We confirmed that results of KJCC had consistent and correct value. Here we will summarize the results for R11027B and K11017A.
Procedure of data analysis was performed as below. And the same parameter was used for all correlation result during analysis. Analysis for spectral-line was adopted with following procedure, but analysis for continuum was excluded for 9 and 10 stages.
Table 2. Observation experiments list.
Experiment Object Source Recorder Comparison correlator
R11027B KJCC evaluation Continuum, Spectral line DIR2K, Mark5B MTK FX, DiFX
R11026A Long time phase monitoring Continuum DIR1K, DIR2K, Mark5B MTK FX
K11017A 2 frequency simultaneous observation Continuum Mark5B DiFX
K12098C 4 frequency simultaneous observation Continuum Mark5B DiFX



FITLD-MSORT-USUBA-INDXR-ACCOR-FRING-CLCAL-APCAL-[BPASS-CVEL:for spectral line]-SPLIT-IMAGR

Data analysis procedure @AIPS.

3.2 Analysis result for continuum (R11027B)

3.2.1 Spectrum of raw data
Figure 3 shows the spectrum shape after completion of FITLD, MSORT, USUBA and INDXR task based on FITS file generated by KJCC and DiFX. Source is 3C454.3 for continuum with Yonsei and Ulsan baseline. Phase for all of 16 IF are continuously changed. The phase slope for DiFX is lower than KJCC, but we think this is caused by adopting the clock-offset precisely while DiFX correlation. After fringe fitting, these values will be deleted and there is no serious problem in current phase slope.
Spectrum shape of 16IF continuum for Yonsei-Ulsan baseline
Figure 3. Spectrum shape of 16IF continuum for Yonsei-Ulsan baseline.
3.2.2 Gain amplitude
We looked into the variation of GAIN for each source for whole observation time after ACCOR. And then in figure 4, gain amplitude was continuously stable for source with long time integration. But in case of source with short integration time, the gain amplitude pattern for KJCC was unstable for time range(between 22:00 and 03:00 for SgrA, Sgr2M) compared with DiFX. This phenomenon was appeared in only KVN station, this is caused with data synchronization while playing back. This phenomenon only occurred beginning of scan about 2~4sec, and the other time range is stable. We recommended the continuous recording of Mark5B while observation.
KJCCMTK FXDiFX
Figure 4. Variation style of gain amplitude for all stations with 9th IF. Left(KJCC), Center(MTK FX), Right(DiFX).
3.2.3 SNR, Delay, Rate after fringe fitting
Figure 5 shows the SNR, Delay and Rate for each baseline, respectively. The reference was set as Ulsan station. Integration time for fringe fitting is 30sec, SNR cutoff is 3. We used 3C454.3 which is very strong radio source in continuum sources and phase pattern is clearly remarkable. For comparison with DiFX, all of the patterns for each result are almost similar without any problems.
KJCC
KJCC
DiFX
Figure 5. SNR, Delay, Rate after FRING for 1st IF of Yonsei. Upper(KJCC), Bottom(DiFX).
3.2.4 Closure phase
By using previous fringe fitting result, Closure phase for 3C454.3 were obtained and showed in figure 6. We confirmed that closure phase was existed within about 5 degree by calculating with variation of phase for whole observation time and by integrating 50~64 channels value of 1st IF for both KJCC and DiFX.
KJCC
DiFX
Figure 6. Closure phase after fringe fitting. Upper(KJCC), Bottom(DiFX).
3.2.5 Spectrum shape after fringe fitting
Figure 7 shows the spectrum shape after fringe fitting. We draw again the spectrum in order to check phase residual by adopting the value of delay, rate after fringe fitting. For more detail comparison, the range of phase was enlarged to 10 degree and only 8 IFs were shown. Phase residual for spectrum of KJCC and DiFX was almost same with 0 value.
KJCCDiFX
Figure 7. Spectrum shape after fringe fitting. Left(KJCC), Right(DiFX).
3.2.6 Imaging performance
New result file was generated with averaging all IFs, all channels, and whole observation time for tables of 3C454.3 source by using SPLIT task. The 2-dimensional image map was generated using new result file and is shown in figure 8. In figure 8, only KVN 3 stations were used for comparison to DiFX. Flux for KJCC is 0.75 Jy/beam, which is less than about 12% compared with 0.84 Jy/beam of DiFX, but the dynamic range is almost same value.
2-dimensional image map using Difmap
Figure 8. 2-dimensional image map using Difmap. Left(KJCC), Right(DiFX).
In addition, we plotted the visibility with 1-dimension at UV for confirmation as shown in figure 9. Figure 9 also shows the same result except the difference of flux both 0.75 Jy of KJCC and 0.84 Jy of DiFX as plotted in above 2-dimensional map.
Flux density according to UV-distance
Figure 9. Flux density according to UV-distance. Left(KJCC), Right(DiFX).

3.3 Analsys result for continuum(K11017A)

3.3.1 Spectrum shape of raw data
This experiment is to evaluate the performance of 2 frequency simultaneous observation and correlated in November 2012. 8 IF was assigned for 22 and 43 GHz respectively and we will report only 8 IFs for 22 GHz. We looked into the spectrum shape of POSSM after FITLD, MSORT, USUBA and INDXR task. The source is NRAO530, which is strong continuum source and shown in figure 10 for Yonsei-Ulsan baseline. Phase of 8 IFs is continuously changed.
Spectrum shape of 8-IFs continuum for Ulsan-Yonsei baseline
Figure 10. Spectrum shape of 8-IFs continuum for Ulsan-Yonsei baseline. Left(KJCC), Right(DiFX).
3.3.2 Gain amplitude
We looked into the Gain amplitude variation of each source for whole observation time after ACCOR as shown in figure 11. KJCC and DiFX had same pattern. This observation was conducted for long time with NRAO150 source, so the loss of 2~4sec at beginning of scan was not affected in correlation result.
Variation style of gain amplitude for each IF of Tamna station
Figure 11. Variation style of gain amplitude for each IF of Tamna station. Left(KJCC), Right(DiFX).
3.3.3 SNR, Delay, Rate after fringe fitting
Figure 12 shows the SNR, Delay and Rate for each baseline, respectively. The reference was set as Ulsan station. Integration time for fringe fitting is 30sec, SNR cutoff is 3. We used 3C454.3 which is very strong radio source in continuum sources and phase pattern is clearly remarkable. For comparison with DiFX, all of the patterns for each result are almost similar without any problems.
KJCC
KJCC
DiFX
Figure 12. SNR, Delay, Rate after FRING for each IF of Tamna station. Left(KJCC), Right(DiFX).
3.3.4 Closure phase
By using previous fringe fitting result, Closure phase for NARO150 were obtained and showed in figure 13. We confirmed that closure phase was about 5 degree by calculating with variation of phase for whole observation time and by integrating 20~109 channels value of 1st IF for both KJCC and DiFX.
Closure phase after fringe fitting
Figure 13. Closure phase after fringe fitting. Upper(KJCC), Bottom(DiFX).
3.3.5 Spectrum shape after fringe fitting and amplitude-cal
We draw again the spectrum in order to check phase residual by adopting the value of delay, rate after fringe fitting as shown in figure 14. For more detail comparison, the range of phase was enlarged to 10 degree and only 8 IFs were shown. Phase residual for spectrum of KJCC and DiFX was almost same. And in order to compare the flux, amplitude calibration was also applied. We confirmed that flux of KJCC has about 10% lower flux than DiFX as described in R11027B experimental result.
Spectrum shape after fringe fittin and amplitude calibration
Figure 14. Spectrum shape after fringe fittin and amplitude calibration. Left(KJCC), Right(DiFX).
3.3.6 UV coverage, UV plot
UV coverage or UV plot methods are widely used to confirm how much made up for the UV during observation of NRAO150 source. UV plot is very useful to understand the flux distribution and structure of source. Figure 15 shows the UV coverage and UV plot for KJCC correlation result. From pattern of UV plot, we could understand that NRAO150 source is the bright spot with flat in KVN only baseline(less than about 30Mlambda).
the UV coverage (Left) and the amplitude of UV data(Right)
Figure 15. the UV coverage (Left) and the amplitude of UV data(Right).
3.3.7 Imaging performance
New result file was generated with averaging all IFs, all channels, and whole observation time for tables of 3C454.3 source by using SPLIT task. And then 2-dimensional map was plotted using new result file as shown in figure 16. Flux for KJCC is 6.34 Jy/beam, which is less than about 10% compared with 6.83 Jy/beam of DiFX, but the dynamic range is almost same value.
2-dimensional image map using Difmap
Figure 16. 2-dimensional image map using Difmap. Left(KJCC), Right(DiFX).

3.4 Analysis result for spectral-line(R11027B)

3.4.1 Spectrum of raw data
We confirmed the spectrum shape of POSSM task after completion through FITLD, MSORT, USUBA and INDXR tasks by separating only 9 IF of maser source in R11027B FITS file as shown in figure 17. The used maser source is SgrB2M, which shows strong emission line of H2O of 22 GHz. In case of 9th IF, we conducted the comparison work for 3 kinds of correlator such as KJCC, MTK and DiFX. As you can see in figure 17, the entire spectrum shape look like almost same aspect, but KJCC has phase concentration in 0 degree at the beginning of bandwidth because of DC-like component. These DC-like component and phase concentration are currently disappeared.
Spectrum shape of 9th IF of Yonsei and Ulsan baseline
Figure 17. Spectrum shape of 9th IF of Yonsei and Ulsan baseline.
3.4.2 Global fringe fitting(Calibrator)
Spectral-line observation such as maser source is occurred the signal at very limited channel(within 10channels) per one maser spot. Therefore we should firstly apply the clock-offset compensation by performing the global fringe fitting according to the bright calibrator source because it is difficult to get the delay in narrow frequency range. In this case, 3C345 source was used for global fringe fitting and figure 18 shows the delay calculated by setting the reference as Tamna station. KJCC and MTK had almost same pattern of delay, because same delay parameter was used for correlation. In case of DiFX, it has more small delay value, and we think that this was caused by applying the more detail clock-offset compensation during correlation of DiFX. In figure 18, the delay of correlation result looks good without any problem.
Fringe fitting result of 3C345 as calibrator source
Figure 18. Fringe fitting result of 3C345 as calibrator source.
3.4.3 SNR after fringe fitting(maser)
Fringe fitting was again conducted for maser source by applying the delay value obtained after global fringe fitting. Although fringe fitting for continuum was done in accordance with entire channel, fringe fitting for spectral-line was done with only one channel which has peak value. In this figure, 197th channel has strong flux, so the fringe fitting was done with this channel. Figure 19 shows the variation of SNR of maser source for each station based on Tamna station. KJCC, MTK, and DiFX had almost same SNR and variation pattern also look like same.
Fringe fitting result of SgrB2M as maser source, and this figure shows SNR based on Tamna station
Figure 19. Fringe fitting result of SgrB2M as maser source, and this figure shows SNR based on Tamna station.
3.4.4 Spectrum shape after compensation of Dopper effect, amplitude calibration and fringe fitting
In VLBI observation, the Dopper effect such as the earth rotation or revolution is being affected at each station. Therefore, Dopper effect should be compensated at the data analysis stage. CVEL command of AIPS is used for the Dopper effect compensation. Amplitude calibration was also performed so as to convert power level to real flux value for each station. The results were shown in figure 20. The Dopper effect was successfully compensated for FITS file of 3 correlation result. The unit for each result is Jy unit.
Spectrum shape after fringe fitting, Dopper effect and amplitude calibration
Figure 20. Spectrum shape after fringe fitting, Dopper effect and amplitude calibration.
3.4.5 UV coverage, UV plot
It is very simple way to confirm the UV coverage in order to know how UV was filled with during observation of SgrB2M maser source. It is helpful to know the structure and distribution of flux of source as UV-distance. Figure 21 shows the UV coverage and UV plot of KJCC correlation result. From pattern of UV plot, SgrB2M has the structure of Gaussian distribution at KVN+VERA 7 stations, and it looks like the bright spot with flat in KVN only baseline(less than about 30Mlambda).
UV coverageUV plot(Right) of SgrB2M
Figure 21. UV coverage(Left) and UV plot(Right) of SgrB2M. UV plot looks like Gaussian distribution, but only KVN baseline seems to be flat.
3.4.6 Imaging performance(single channel)
We conducted the imaging work with special channel using maser source as well as continuum source. In case of data processing stage for spectral-line, BPASS and CVEL task were additionally done. The result file was generated by applying result tables for SgrB2M using SPLIT task. For comparison with DiFX, data for only KVN 3 stations was plotted in the same way of continuum source as shown in figure 22. Flux density for KJCC is about 10% lower than DiFX, but dynamic range is almost same.
2-dimensional image map using AIPS KJCC2-dimensional image map using AIPS DiFX
Figure 22. 2-dimensional image map using AIPS. Left(KJCC), Right(DiFX).
3.4.7 Imaging performance(multi channel)
In case of maser source, maser spots are existed with several tens and thousands in the uniform range. In general, imaging of maser source is performed as follows. Firstly we found each peak channel as refer to spectrum, and then the position of whole maser spots as indicated. Finally 2-dimensional distribution map is plotted. In this experiment, in order to reproduce image, the position was obtained by imaging for several maser spot, and then we confirmed whether the position of maser spot for DiFX result was consistent or not. We conducted the multi channel imaging work as shown in figure 23 so as to find the maser position, and confirmed that the maser spot for 264th, 269th, 274th, 280th, and 284th channel was detected.
Example of multi-channel imageImage result for each 261th-290th channel
Figure 23. Example of multi-channel image. Image result for each 261th-290th channel.

Figure 24 shows the 2-dimension map of maser spot for KJCC and DiFX, respectively. Bottom figure was overlapped with both KJCC and DiFX. The position error of KJCC and DiFX is less than 0.2 milli-arcsecond, this means that two map are mostly consistent as synthesized beam size with 2% level of 10 milli-arcsecond. Upper figure shows the overlapped map for more understanding step aside.
Figure overlapped with KJCC and DiFX
Figure 24. Figure overlapped with KJCC and DiFX.

Specifications of Deajeon Correlator

Item Description
Observation Array Constitution
- Number of Stations
- Number of Inputs for a station
- Sub-array Constitution
- Total number of Correlation
 
- (max.) 16 stations
- (max.) 4 inputs
- 4+12 stations / 8+8 stations
- (max.) (16 Auto- + 120 Cross-) × 4 sets
Observation Requirements
- Observation Frequency
- Largest Baseline Length
- Maximum Baseline Velocity
- Frequency Resolution
- Dual Polarization
- P-cal Detection
- Maximum Data Output Rate
 
- (space VLBI)45GHz, (Others)130/86/43/22GHz
- ± 36,000 km (±0.12 sec)
- 7.5 km/sec
- 53.3m/sec (for 22GHz Observation)
- Yes, for only 8 stations at once
- Yes
- 1.4 GBytes/sec
Input Data Profiles
- Digitization
- Quantization Levels
- Interface
- PDATA Acceptance
- Data Rate
- Input Format
- 1024 Msamples/sec × 2 bits/sample
- 4 levels as "00" < "01" < "10" < "11"
- VSI-H (32parallels data, 1PPS, VALID, PDATA)
- As "format A" of ADS-1000
- 2Gbps / 1Gbps
- Wide Band Mode (1Gsps x 2bits)
- Narrow Band Mode (1Gbps/512Mbps Multi Data Streams)
- Narrow Band Mode2(2Gbps Multi Data Streams)
Input Data Control
- Rate up Data Acceptance
- Stream Selection & Multiplexing
 
- Yes, Double rate(form 1Gbps) / Quadruple rate(from 512Mbps)
- Yes
Delay Compensation & Fringe tracking
- Delay Prediction Parameters
- Delay Compensation Period
- Fringe phase quantization
- Fringe phase applying range
- Word length of Fringe tracking
 
- τg , τg’, τg” and τg’’’ (for 1.024 sec)
- According to FFT segment border
- 2π/16 radian
- every 1samples
- 16bits, 2's complement
Special Analysis
- FFT points
- Word length
- Window modulation
- Delay residual(△w) compensation
- Scaling
- Cancellation DC-offset
- Frequency Offset Addition
- Re-quantization
 
- 256k / 128k / 64k / 32k / 16k / 8k points ("k" means "×1,024")
- Fixed point 20+20 bits (real + imaginary)
- Yes, 4 kinds as "Rectangular" / "Hamming" / "Hanning" / "Blackman"
- Yes
- Yes
- Yes
- Yes
- Fixed point 8+8 bits (real + imaginary) : The Output are only USB or LSB
Correlation & Accumulation
- Word length of Correlation
- Station Data Switching
- Word length of Accumulation
- Integration Period
- Frequency binning / Frequency binning setting points
- Points of Correlation Output Data
- Correlation Output Data Interface
 
- Fixed point (8+8) bits → (15+15) bits
- Yes
- Fixed point (32+32) bits (real + imaginary)
- 25.6msec/51.2ms/102.4ms - 10.24sec(102.4ms unit)
- Yes, 1 / 2 / 4 / 8 / 16 / 32 / 64 / 128 / 256 channels bin.
- Yes, (for each 512-points of output)
- 8,192-points(for each correlation). Each points are result of binning
Control Interface - 10Gbits Ether × 4 ports, TCP/IP, Based on VSI-S

Correlation Mode

Correlation Mode Data Constitution Current Possibility
Wide Band Mode 1Gsps x 2-bits x 4-streams/station
  • W1: 4 independent inputs(4Fx1P)
  • W2: 1 polarization pair+2 independent inputs (1Fx2P+2Fx1P)
  • W3: 2 polarization pairs(2Fx2P)
W1 is available.
Narrow Band Mode1 1Gbps or 512Mbps Multi Data Streams/Station
- Rate up to 2Gbps 10 patterns are as follows :
  • C1 : 256MHz BW x 1-stream
  • C2 : 128MHz BW x 2-streams
  • C3 : 64MHz BW x 4-streams
  • C4 : 32MHz BW x 8-streams
  • C5 : 16MHz BW x 16-streams
  • C6 : 8MHz BW x 16-streams
  • C7 : 64MHz BW x 2-streams + 128MHz BW x 1-stream
  • C8 : 32MHz BW x 2-streams + 64MHz BW x 1-stream + 128MHz BW x 1-stream
  • C9 : 32MHz BW x 4-streams + 128MHz BW x 1-stream
  • C10 : 16MHz BW x 2-streams + 32MHz BW x 3-streams + 128MHz BW x 1-stream
C1/C2/C3/C4/C5 are available.
Narrow Band Mode2 2Gbps Multi Data Streams/station
- Same as Narrow Band Mode
- Bandwidth is double
- C6 is excluded
Not Yet

KASI logo image

Korea-Japan Correlation Center